00000001:02000400:2.0F:1782727763.937093:0:2960:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg231-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1782727783.136751:0:3179:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1782727785.279848:0:3232:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 507 MB/s 00000001:01000000:2.0:1782727785.530317:0:3232:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 603 MB/s 00000001:01000000:1.0F:1782727785.781343:0:3232:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4191 MB/s 00000020:02000000:1.0:1782727786.853124:0:3283:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_83_gbddb8b7 00000400:02000000:0.0:1782727787.796539:0:3298:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.202.131@tcp [8/256/0/180] 00008000:02000000:1.0:1782727791.602963:0:3447:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1782727840.780425:0:5252:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1782727847.813906:0:5787:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1782727847.813913:0:5787:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1782727847.814063:0:5787:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000063780a60 00000080:02000400:1.0:1782727847.814076:0:5787:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1782727847.825379:0:5787:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1782727847.825395:0:5787:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1782727847.825445:0:5787:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000006c1da68f) 00000020:00000080:1.0:1782727847.825469:0:5787:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0F:1782727847.868305:0:5787:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1782727847.871286:0:5787:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1782727847.902043:0:5787:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1782727847.902087:0:5787:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1782727847.902111:0:5787:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1782727847.902166:0:5787:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1782727847.902194:0:5787:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1782727847.902637:0:5787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1782727847.902646:0:5787:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782727847.902657:0:5787:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22171c6c29614a97 00000020:01000004:2.0:1782727847.902664:0:5787:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1782727847.902669:0:5787:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1782727847.902673:0:5787:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000063780a60 from MGS 00000020:01000004:2.0:1782727847.902677:0:5787:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1782727847.902705:0:5787:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000090bc7c9c) 00000020:00000080:2.0:1782727847.902716:0:5787:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1782727847.902830:0:5787:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000063780a60 from MGS, refs=2 00080000:01000000:2.0:1782727847.902835:0:5787:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782727847.902841:0:5787:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22171c6c29614aa5 00000100:00100000:2.0:1782727847.902994:0:5787:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1782727847.903109:0:5787:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1782727847.903114:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1782727847.903957:0:5787:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1782727847.903965:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1782727847.904985:0:5787:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782727847.905151:0:5787:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1782727847.905156:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1782727847.905790:0:5787:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1782727847.905797:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1782727847.906237:0:5787:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1782727847.906252:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1782727847.907211:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727847.907215:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727847.907217:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727847.907574:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727847.907576:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727847.907578:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727847.908190:0:5787:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1782727847.914123:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1782727848.158573:0:5787:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2737 MB/s 00000001:01000000:3.0:1782727848.408660:0:5787:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3807 MB/s 00000001:01000000:2.0:1782727848.659122:0:5787:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 471 MB/s 00000001:01000000:2.0:1782727848.908871:0:5787:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 479 MB/s 00080000:10000000:2.0:1782727848.921497:0:5787:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1782727848.942123:0:5787:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1782727848.942140:0:5787:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1782727848.942143:0:5787:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:1.0:1782727848.942362:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782727848.943262:0:5797:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1782727848.943328:0:5787:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1782727848.943384:0:5787:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1782727848.943592:0:5787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1782727848.943613:0:5787:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1782727848.943990:0:5787:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782727848.944154:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1782727848.944160:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1782727848.950768:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1782727848.950790:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1782727848.954253:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1782727848.954266:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1782727848.955385:0:5787:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1782727848.955407:0:5787:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.202.131@tcp' 00000020:01000004:3.0:1782727848.955409:0:5787:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1782727848.955459:0:5787:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.202.131@tcp (typ=mgc) 00000020:00000080:3.0:1782727848.955479:0:5787:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.131@tcp (00000000faac9e76) 00000020:00000080:3.0:1782727848.955497:0:5787:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1782727848.955701:0:5787:0:(ldlm_lib.c:102:import_set_conn()) imp 000000001c01bdcd@MGC192.168.202.131@tcp: add connection 192.168.202.131@tcp at head 00010000:00010000:3.0:1782727848.956158:0:5787:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.131@tcp-0 is initialized 00000040:01000000:3.0:1782727848.956165:0:5787:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.131@tcp ctxt 1 is initialized 10000000:01000000:2.0:1782727848.958279:0:5803:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1782727848.958326:0:5787:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.131@tcp (uuid be2b8b9a-65d9-4ad9-ab60-33b0c7c11365) 00000020:00000080:2.0:1782727848.958347:0:5787:0:(genops.c:1406:class_connect()) connect: client be2b8b9a-65d9-4ad9-ab60-33b0c7c11365, cookie 0x22171c6c29614ab3 00000100:00080000:2.0:1782727848.958361:0:5787:0:(import.c:512:import_select_connection()) MGC192.168.202.131@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782727848.958366:0:5787:0:(import.c:626:import_select_connection()) MGC192.168.202.131@tcp: import 000000001c01bdcd using connection 192.168.202.131@tcp/0@lo 00000100:00100000:2.0:1782727848.958414:0:5787:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d209aa41 x1869325571981440/t0(0) o250->MGC192.168.202.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782727848.958437:0:5787:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import be2b8b9a-65d9-4ad9-ab60-33b0c7c11365->MGS 00000020:01000004:2.0:1782727848.958455:0:5787:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1782727848.958481:0:5787:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1782727848.958493:0:5787:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000005b5f6382) 00000020:00000080:2.0:1782727848.958505:0:5787:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:1.0:1782727848.959972:0:5802:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1782727848.969248:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d209aa41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3313:1869325571981440:0@lo:250: 00000100:00100000:0.0:1782727848.969338:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727848.969419:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571981440 00000100:00100000:0.0:1782727848.969428:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571981440 00000100:00100000:0.0:1782727848.969475:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782727848.969482:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069b2a72c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3313:x1869325571981440:12345-0@lo:250: 00010000:00080000:0.0:1782727848.969600:0:5798:0:(ldlm_lib.c:1434:target_handle_connect()) MGS: connection from be2b8b9a-65d9-4ad9-ab60-33b0c7c11365@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:0.0:1782727848.969628:0:5798:0:(genops.c:1406:class_connect()) connect: client be2b8b9a-65d9-4ad9-ab60-33b0c7c11365, cookie 0x22171c6c29614ac1 00000100:00080000:0.0:1782727848.970893:0:5798:0:(import.c:65:import_set_state_nolock()) 000000006f5cce68 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782727848.970974:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069b2a72c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+5:3313:x1869325571981440:12345-0@lo:250: Request processed in 1490us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727848.970984:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782727848.971039:0:3313:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.202.131@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1782727848.971049:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.202.131@tcp: connect to target with instance 0 00000100:00080000:0.0:1782727848.971056:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.202.131@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1782727848.971061:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1782727848.971065:0:3313:0:(import.c:65:import_set_state_nolock()) 000000001c01bdcd MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1782727848.971068:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1782727848.971083:0:3313:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1782727848.971089:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d209aa41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3313:1869325571981440:0@lo:250: 00000100:00100000:2.0:1782727848.979321:0:5787:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782727848.979685:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1782727848.979692:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1782727848.980406:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1782727848.980413:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1782727848.980892:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1782727848.980902:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1782727848.981992:0:5787:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782727848.982205:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1782727848.982209:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1782727848.982936:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1782727848.982944:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1782727849.029971:0:5787:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782727849.030309:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1782727849.030323:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1782727849.033173:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1782727849.033185:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1782727849.033847:0:5787:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782727849.034114:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782727849.034121:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1782727849.034601:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1782727849.034608:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1782727849.035231:0:5787:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782727849.035376:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782727849.035380:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1782727849.036103:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1782727849.036111:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1782727849.039331:0:5787:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782727849.039600:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1782727849.039607:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1782727849.040335:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1782727849.040343:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1782727849.057911:0:5787:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782727849.058183:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1782727849.058188:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1782727849.059929:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1782727849.059940:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1782727849.066015:0:5787:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1782727849.066043:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1782727849.068343:0:5787:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1782727849.068369:0:5787:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1782727849.068375:0:5787:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.131@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1782727849.068499:0:5787:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.131@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782727849.069188:0:5787:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.131@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1782727849.069193:0:5787:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782727849.069195:0:5787:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782727849.069196:0:5787:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727849.069197:0:5787:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782727849.069198:0:5787:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727849.069199:0:5787:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727849.069201:0:5787:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782727849.069209:0:5787:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782727849.069210:0:5787:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782727849.069211:0:5787:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782727849.069212:0:5787:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727849.069214:0:5787:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782727849.069216:0:5787:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1782727849.069218:0:5787:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782727849.069219:0:5787:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782727849.069220:0:5787:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727849.069221:0:5787:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782727849.069221:0:5787:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727849.069222:0:5787:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727849.069223:0:5787:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782727849.069224:0:5787:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782727849.069224:0:5787:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782727849.069225:0:5787:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782727849.069226:0:5787:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727849.069227:0:5787:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782727849.069264:0:5787:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1782727849.069282:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000021a9f3eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571981568:0@lo:253: 00000100:00100000:3.0:1782727849.069353:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727849.069476:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set 000000003e5f8602 going to sleep for 11 seconds 00000100:00100000:0.0:1782727849.069843:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571981568 00000100:00100000:0.0:1782727849.069851:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571981568 00000100:00100000:0.0:1782727849.070227:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782727849.070237:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc1de096 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+5:5787:x1869325571981568:12345-0@lo:253: 20000000:01000000:0.0:1782727849.070287:0:5801:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1782727849.070290:0:5801:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1782727849.071800:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1782727849.071877:0:5801:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1782727849.072334:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782727849.073864:0:5824:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1782727849.074266:0:5801:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1782727849.074271:0:5801:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1782727849.074277:0:5801:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1782727849.074280:0:5801:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1782727849.074297:0:5801:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1782727849.074683:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782727849.075113:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1782727849.075129:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1782727849.075186:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1782727849.075241:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1782727849.075285:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1782727849.075386:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1782727849.075395:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1782727849.075446:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1782727849.075455:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1782727849.075491:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1782727849.075498:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1782727849.075673:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1782727849.075836:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1782727849.075871:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1782727849.075876:0:5801:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1782727849.075891:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782727849.076243:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1782727849.076254:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1782727849.076292:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1782727849.076328:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1782727849.076378:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1782727849.076391:0:5801:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1782727849.076468:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1782727849.076477:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1782727849.076679:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1782727849.076812:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1782727849.076855:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1782727849.076866:0:5801:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1782727849.076960:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1782727849.076970:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1782727849.077143:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1782727849.077180:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1782727849.077344:0:5801:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1782727849.077386:0:5801:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1782727849.077393:0:5801:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1782727849.078144:0:5825:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1782727849.078457:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1782727849.078479:0:5801:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.131@tcp for mdt 20000000:01000000:0.0:1782727849.078481:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.131@tcp (null) (null) (null) 00000040:00080000:0.0:1782727849.078688:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1782727849.078698:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1782727849.078744:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1782727849.078753:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.131@tcp (null) (null) 00000040:00080000:0.0:1782727849.078798:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1782727849.078807:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1782727849.078856:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1782727849.078891:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1782727849.078946:0:5801:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1782727849.078949:0:5801:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1782727849.078953:0:5801:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1782727849.078964:0:5801:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1782727849.078967:0:5801:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1782727849.079131:0:5801:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1782727849.079134:0:5801:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1782727849.079589:0:5826:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1782727849.079822:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1782727849.079859:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1782727849.079894:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1782727849.079914:0:5801:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1782727849.079916:0:5801:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1782727849.081100:0:5827:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1782727849.082194:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1782727849.082238:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1782727849.082306:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1782727849.082322:0:5801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782727849.082324:0:5801:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1782727849.082329:0:5801:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1782727849.082332:0:5801:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1782727849.082338:0:5801:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1782727849.082344:0:5801:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1782727849.083354:0:5828:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1782727849.083579:0:5801:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1782727849.097398:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1782727849.097443:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1782727849.097782:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1782727849.097805:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1782727849.097839:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001a037b55/0x22171c6c29614ac8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727849.097859:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001a037b55/0x22171c6c29614ac8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727849.097869:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001a037b55/0x22171c6c29614ac8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727849.097874:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001a037b55/0x22171c6c29614ac8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727849.097881:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001a037b55/0x22171c6c29614ac8 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727849.097898:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001a037b55/0x22171c6c29614ac8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727849.097904:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001a037b55 already unused, calling callback (0000000058dcbfca) 00010000:00010000:0.0:1782727849.097908:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001a037b55/0x22171c6c29614ac8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727849.097915:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001a037b55/0x22171c6c29614ac8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727849.097929:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001a037b55/0x22171c6c29614ac8 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727849.097936:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001a037b55/0x22171c6c29614ac8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727849.097942:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001a037b55/0x22171c6c29614ac8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782727849.097961:0:5801:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1782727849.317049:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc1de096 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+5:5787:x1869325571981568:12345-0@lo:253: Request processed in 246808us (247689us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727849.317070:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782727849.317262:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000021a9f3eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571981568:0@lo:253: 10000000:01000000:3.0:1782727849.317279:0:5787:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1782727849.317282:0:5787:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782727849.317284:0:5787:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782727849.317285:0:5787:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727849.317286:0:5787:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1782727849.317287:0:5787:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727849.317289:0:5787:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727849.317290:0:5787:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782727849.317291:0:5787:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782727849.317293:0:5787:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1782727849.317294:0:5787:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727849.317295:0:5787:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782727849.317314:0:5787:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000063780a60 from lustre-MDT0000 10000000:01000000:3.0:1782727849.317340:0:5787:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1782727849.317349:0:5787:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1782727849.317353:0:5787:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d56d0964d70 10000000:01000000:3.0:1782727849.317357:0:5787:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782727849.317365:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8d56d0964d70 from 1 10000000:01000000:3.0:1782727849.317368:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782727849.317489:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: 000000000b6b0130/0x22171c6c29614acf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.317501:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: 000000000b6b0130/0x22171c6c29614acf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.317561:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: 000000000b6b0130/0x22171c6c29614acf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727849.317583:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000021a9f3eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571981696:0@lo:101: 00000100:00100000:3.0:1782727849.317622:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727849.317673:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set 00000000080ade0b going to sleep for 11 seconds 00000100:00100000:0.0:1782727849.317739:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571981696 00000100:00100000:0.0:1782727849.317746:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571981696 00000100:00100000:0.0:1782727849.317791:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782727849.317800:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d44c567 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+5:5787:x1869325571981696:12345-0@lo:101: 00010000:00010000:0.0:1782727849.317826:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727849.317841:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001a037b55/0x22171c6c29614ad6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614acf expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727849.317869:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001a037b55/0x22171c6c29614ad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614acf expref: 6 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727849.317888:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001a037b55/0x22171c6c29614ad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614acf expref: 6 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727849.317897:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001a037b55, rc 0) 00000100:00100000:0.0:1782727849.317942:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d44c567 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+6:5787:x1869325571981696:12345-0@lo:101: Request processed in 144us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727849.317949:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782727849.318163:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000021a9f3eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571981696:0@lo:101: 00010000:00010000:3.0:1782727849.318177:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: 000000000b6b0130/0x22171c6c29614acf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614ad6 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.318186:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: 000000000b6b0130/0x22171c6c29614acf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614ad6 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727849.318238:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000021a9f3eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571981824:0@lo:501: 00000100:00100000:3.0:1782727849.318266:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727849.318288:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set 00000000080ade0b going to sleep for 11 seconds 00000100:00100000:2.0:1782727849.318350:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571981824 00000100:00100000:2.0:1782727849.318354:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571981824 00000100:00100000:2.0:1782727849.318391:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782727849.318399:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007689561 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+6:5787:x1869325571981824:12345-0@lo:501: 00000100:00100000:2.0:1782727849.318832:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007689561 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+6:5787:x1869325571981824:12345-0@lo:501: Request processed in 433us (564us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782727849.318839:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782727849.318919:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000021a9f3eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571981824:0@lo:501: 10000000:01000000:3.0:1782727849.318950:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782727849.318975:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: 000000000b6b0130/0x22171c6c29614acf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614ad6 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.318983:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: 000000000b6b0130/0x22171c6c29614acf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614ad6 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727849.318990:0:5787:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d56c8fb6000 10000000:01000000:3.0:1782727849.318994:0:5787:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782727849.318999:0:5787:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d56c8fb6000 10000000:01000000:3.0:1782727849.319001:0:5787:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1782727849.319013:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8d56c8fb6000 from 1 10000000:01000000:3.0:1782727849.319015:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1782727849.319035:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: 000000005454150b/0x22171c6c29614add lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.319043:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: 000000005454150b/0x22171c6c29614add lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.319051:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: 000000005454150b/0x22171c6c29614add lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727849.319064:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000021a9f3eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571981952:0@lo:101: 00000100:00100000:3.0:1782727849.319091:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727849.319115:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set 00000000080ade0b going to sleep for 11 seconds 00000100:00100000:3.0:1782727849.319133:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571981952 00000100:00100000:3.0:1782727849.319137:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571981952 00000100:00100000:3.0:1782727849.319161:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782727849.319167:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad8c6807 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+6:5787:x1869325571981952:12345-0@lo:101: 00010000:00010000:3.0:1782727849.319174:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727849.319186:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dda482bf/0x22171c6c29614ae4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614add expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.319212:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dda482bf/0x22171c6c29614ae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614add expref: 7 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.319220:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dda482bf/0x22171c6c29614ae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614add expref: 7 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.319227:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dda482bf, rc 0) 00000100:00100000:3.0:1782727849.319256:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad8c6807 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+7:5787:x1869325571981952:12345-0@lo:101: Request processed in 90us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727849.319262:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782727849.319293:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000021a9f3eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571981952:0@lo:101: 00010000:00010000:3.0:1782727849.319303:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: 000000005454150b/0x22171c6c29614add lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614ae4 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.319310:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: 000000005454150b/0x22171c6c29614add lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614ae4 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727849.319321:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1782727849.319324:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: 000000005454150b/0x22171c6c29614add lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614ae4 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.319329:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: 000000005454150b/0x22171c6c29614add lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614ae4 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727849.319335:0:5787:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1782727849.319338:0:5787:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782727849.319343:0:5787:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d56c8fb6000 10000000:01000000:3.0:1782727849.319345:0:5787:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1782727849.319353:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1782727849.319355:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782727849.319368:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: 00000000c9ae75f4/0x22171c6c29614aeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.319374:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: 00000000c9ae75f4/0x22171c6c29614aeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.319380:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: 00000000c9ae75f4/0x22171c6c29614aeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727849.319391:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000021a9f3eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571982080:0@lo:101: 00000100:00100000:3.0:1782727849.319599:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727849.319617:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set 00000000080ade0b going to sleep for 11 seconds 00000100:00100000:3.0:1782727849.319631:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571982080 00000100:00100000:3.0:1782727849.319634:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571982080 00000100:00100000:3.0:1782727849.319652:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782727849.319657:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082b752bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+7:5787:x1869325571982080:12345-0@lo:101: 00010000:00010000:3.0:1782727849.319663:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727849.319669:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b5ce7bdc/0x22171c6c29614af2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614aeb expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.319682:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b5ce7bdc/0x22171c6c29614af2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614aeb expref: 8 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.319689:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b5ce7bdc/0x22171c6c29614af2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614aeb expref: 8 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.319696:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b5ce7bdc, rc 0) 00000100:00100000:3.0:1782727849.319722:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082b752bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+8:5787:x1869325571982080:12345-0@lo:101: Request processed in 65us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727849.319734:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782727849.319762:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000021a9f3eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571982080:0@lo:101: 00010000:00010000:3.0:1782727849.319770:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: 00000000c9ae75f4/0x22171c6c29614aeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614af2 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.319777:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: 00000000c9ae75f4/0x22171c6c29614aeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614af2 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727849.319812:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000021a9f3eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571982208:0@lo:501: 00000100:00100000:3.0:1782727849.319834:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727849.319845:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set 00000000080ade0b going to sleep for 11 seconds 00000100:00100000:3.0:1782727849.319858:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571982208 00000100:00100000:3.0:1782727849.319861:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571982208 00000100:00100000:3.0:1782727849.319877:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782727849.319882:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000506bfa64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+8:5787:x1869325571982208:12345-0@lo:501: 00000100:00100000:2.0:1782727849.320752:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000506bfa64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+9:5787:x1869325571982208:12345-0@lo:501: Request processed in 867us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727849.320762:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782727849.320960:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000021a9f3eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571982208:0@lo:501: 00000100:00100000:3.0:1782727849.320998:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000021a9f3eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571982336:0@lo:503: 00000100:00100000:3.0:1782727849.321117:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727849.321185:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set 00000000080ade0b going to sleep for 11 seconds 00000100:00100000:2.0:1782727849.321222:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571982336 00000100:00100000:2.0:1782727849.321228:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571982336 00000100:00100000:2.0:1782727849.321308:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782727849.321315:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e7d8776 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+9:5787:x1869325571982336:12345-0@lo:503: 00000100:00100000:2.0:1782727849.321576:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e7d8776 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+9:5787:x1869325571982336:12345-0@lo:503: Request processed in 262us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727849.321583:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782727849.321645:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000021a9f3eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571982336:0@lo:503: 00000100:00100000:3.0:1782727849.322084:0:5830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000021a9f3eb pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5830:1869325571982464:0@lo:502: 00000100:00100000:3.0:1782727849.322116:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727849.322203:0:5830:0:(client.c:2701:ptlrpc_set_wait()) set 000000008028fd16 going to sleep for 11 seconds 00000100:00100000:0.0:1782727849.322282:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571982464 00000100:00100000:0.0:1782727849.322287:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571982464 00000100:00100000:0.0:1782727849.322310:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782727849.322315:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccebeb17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+9:5830:x1869325571982464:12345-0@lo:502: 00000100:00100000:0.0:1782727849.322556:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccebeb17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+9:5830:x1869325571982464:12345-0@lo:502: Request processed in 240us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727849.322564:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782727849.322644:0:5830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000021a9f3eb pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5830:1869325571982464:0@lo:502: 00000020:01000000:3.0:1782727849.322669:0:5830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782727849.322686:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727849.322688:0:5830:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1782727849.322693:0:5830:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1782727849.322695:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782727849.322708:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000313128ac) 00000020:00000080:3.0:1782727849.322724:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1782727849.322728:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1782727849.322796:0:5830:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1782727849.322801:0:5830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22171c6c29614b00 00000020:00000080:3.0:1782727849.323137:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1782727849.323141:0:5830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782727849.323144:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727849.323145:0:5830:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1782727849.323147:0:5830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782727849.323150:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727849.323151:0:5830:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1782727849.323154:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782727849.323160:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000c9ee2d73) 00000020:00000080:3.0:1782727849.323168:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1782727849.323171:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1782727849.323173:0:5830:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1782727849.323175:0:5830:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1782727849.323180:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782727849.323218:0:5830:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000063780a60 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1782727849.323228:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000c91e5208) 00000020:00000080:3.0:1782727849.323234:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1782727849.323285:0:5830:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1782727849.323289:0:5830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22171c6c29614b15 00000020:00000080:3.0:1782727849.323369:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1782727849.323374:0:5830:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1782727849.323377:0:5830:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x22171c6c29614b1c 00080000:01000000:3.0:1782727849.323380:0:5830:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1782727849.323383:0:5830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22171c6c29614b23 00080000:10000000:3.0:1782727849.324068:0:5830:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1782727849.324266:0:5830:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1782727849.328575:0:5830:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1782727849.400733:0:5830:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1782727849.401259:0:5830:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1782727849.404101:0:5830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1782727849.404485:0:5830:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1782727849.434133:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000a5bf384c) 00000020:00000080:1.0:1782727849.434159:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1782727849.434252:0:5830:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1782727849.434259:0:5830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22171c6c29614b31 00000020:00000080:1.0:1782727849.434797:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1782727849.437717:0:5830:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1782727849.519683:0:5830:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1782727849.573101:0:5830:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1782727849.612683:0:5830:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1782727849.660064:0:5830:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1782727849.694005:0:5830:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1782727849.721662:0:5830:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x22171c6c29614b38 00000020:00000080:0.0:1782727849.722107:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1782727849.722118:0:5830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727849.722124:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727849.722126:0:5830:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1782727849.722129:0:5830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727849.722133:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727849.722134:0:5830:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782727849.722137:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782727849.722138:0:5830:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782727849.722146:0:5830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727849.722149:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727849.722150:0:5830:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1782727849.722152:0:5830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727849.722156:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727849.722157:0:5830:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1782727849.722161:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1782727849.722196:0:5830:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1782727849.722268:0:5830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001622767f pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5830:1869325571982592:0@lo:502: 00000100:00100000:0.0:1782727849.722348:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727849.722409:0:5830:0:(client.c:2701:ptlrpc_set_wait()) set 000000003d660c03 going to sleep for 11 seconds 00000100:00100000:1.0:1782727849.722488:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571982592 00000100:00100000:1.0:1782727849.722502:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571982592 00000100:00100000:1.0:1782727849.722587:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782727849.722595:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d39262eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+9:5830:x1869325571982592:12345-0@lo:502: 00000100:00100000:1.0:1782727849.722941:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d39262eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+9:5830:x1869325571982592:12345-0@lo:502: Request processed in 345us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727849.722949:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782727849.723123:0:5830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001622767f pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5830:1869325571982592:0@lo:502: 00000020:01000000:0.0:1782727849.723151:0:5830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727849.723156:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727849.723158:0:5830:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1782727849.723162:0:5830:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1782727849.723346:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1782727849.723365:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782727849.723391:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: 00000000c9ae75f4/0x22171c6c29614aeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614af2 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.723402:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: 00000000c9ae75f4/0x22171c6c29614aeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614af2 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727849.723411:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8d56c8fb6000 from 1 10000000:01000000:1.0:1782727849.723414:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782727849.723454:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: 000000001732336f/0x22171c6c29614b3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.723462:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: 000000001732336f/0x22171c6c29614b3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.723470:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: 000000001732336f/0x22171c6c29614b3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727849.723486:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d32f02dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571982720:0@lo:101: 00000100:00100000:1.0:1782727849.723560:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727849.723592:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set 000000004a69ecd3 going to sleep for 11 seconds 00000100:00100000:3.0:1782727849.723659:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571982720 00000100:00100000:3.0:1782727849.723665:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571982720 00000100:00100000:3.0:1782727849.723700:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782727849.723707:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b288f77e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+9:5787:x1869325571982720:12345-0@lo:101: 00010000:00010000:3.0:1782727849.723717:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727849.723731:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000062fd5dc2/0x22171c6c29614b46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614b3f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.723755:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000062fd5dc2/0x22171c6c29614b46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614b3f expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.723765:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000062fd5dc2/0x22171c6c29614b46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614b3f expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.723775:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000062fd5dc2, rc 0) 00000100:00100000:3.0:1782727849.723807:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b288f77e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+10:5787:x1869325571982720:12345-0@lo:101: Request processed in 100us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727849.723827:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782727849.724019:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d32f02dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571982720:0@lo:101: 00010000:00010000:1.0:1782727849.724043:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: 000000001732336f/0x22171c6c29614b3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614b46 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.724051:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: 000000001732336f/0x22171c6c29614b3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614b46 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727849.724626:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d32f02dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571982848:0@lo:256: 00000100:00100000:1.0:1782727849.724671:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727849.724694:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set 000000004a69ecd3 going to sleep for 11 seconds 00000100:00100000:1.0:1782727849.724716:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571982848 00000100:00100000:1.0:1782727849.724720:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571982848 00000100:00100000:1.0:1782727849.724743:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782727849.724750:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f81d1e3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+10:5787:x1869325571982848:12345-0@lo:256: 20000000:01000000:1.0:1782727849.724766:0:5801:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1782727849.724771:0:5801:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1782727849.725143:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f81d1e3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+10:5787:x1869325571982848:12345-0@lo:256: Request processed in 392us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727849.725151:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782727849.725188:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d32f02dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571982848:0@lo:256: 10000000:01000000:1.0:1782727849.725950:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782727849.726014:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: 000000001732336f/0x22171c6c29614b3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614b46 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.726027:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: 000000001732336f/0x22171c6c29614b3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614b46 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727849.726106:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8d56c8fb6000 from 1 10000000:01000000:0.0:1782727849.726110:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782727849.726145:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: 000000004aad4ae2/0x22171c6c29614b4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727849.726152:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: 000000004aad4ae2/0x22171c6c29614b4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727849.726161:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: 000000004aad4ae2/0x22171c6c29614b4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727849.726179:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001622767f pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571982976:0@lo:101: 00000100:00100000:0.0:1782727849.726227:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727849.726311:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set 000000003d660c03 going to sleep for 11 seconds 00000100:00100000:3.0:1782727849.726361:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571982976 00000100:00100000:3.0:1782727849.726366:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571982976 00000100:00100000:3.0:1782727849.726452:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782727849.726460:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021f09e2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+10:5787:x1869325571982976:12345-0@lo:101: 00010000:00010000:3.0:1782727849.726470:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727849.726484:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008df7d94b/0x22171c6c29614b54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614b4d expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.726552:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008df7d94b/0x22171c6c29614b54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614b4d expref: 11 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.726563:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008df7d94b/0x22171c6c29614b54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614b4d expref: 11 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.726573:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008df7d94b, rc 0) 00000100:00100000:3.0:1782727849.726613:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021f09e2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:5787:x1869325571982976:12345-0@lo:101: Request processed in 155us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727849.726619:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782727849.726707:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001622767f pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571982976:0@lo:101: 00010000:00010000:0.0:1782727849.726719:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: 000000004aad4ae2/0x22171c6c29614b4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614b54 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727849.726727:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: 000000004aad4ae2/0x22171c6c29614b4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614b54 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727849.726773:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001622767f pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571983104:0@lo:501: 00000100:00100000:0.0:1782727849.726799:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727849.727037:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set 000000003d660c03 going to sleep for 11 seconds 00000100:00100000:2.0:1782727849.727065:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571983104 00000100:00100000:2.0:1782727849.727071:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571983104 00000100:00100000:3.0:1782727849.727112:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782727849.727118:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002294075a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:5787:x1869325571983104:12345-0@lo:501: 00000100:00100000:3.0:1782727849.727682:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002294075a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:5787:x1869325571983104:12345-0@lo:501: Request processed in 563us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727849.727690:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782727849.727882:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001622767f pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571983104:0@lo:501: 00000100:00100000:0.0:1782727849.727914:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001622767f pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571983232:0@lo:503: 00000100:00100000:0.0:1782727849.727952:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727849.727969:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set 000000003d660c03 going to sleep for 11 seconds 00000100:00100000:1.0:1782727849.728016:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571983232 00000100:00100000:1.0:1782727849.728021:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571983232 00000100:00100000:1.0:1782727849.728049:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782727849.728054:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ebd260b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:5787:x1869325571983232:12345-0@lo:503: 00000040:00080000:1.0:1782727849.728085:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782727849.728126:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ebd260b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:5787:x1869325571983232:12345-0@lo:503: Request processed in 71us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727849.728132:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782727849.728267:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001622767f pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571983232:0@lo:503: 00000040:00080000:0.0:1782727849.729162:0:5834:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1782727849.729402:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1782727849.729422:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782727849.729444:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: 000000004aad4ae2/0x22171c6c29614b4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614b54 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.729455:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: 000000004aad4ae2/0x22171c6c29614b4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614b54 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727849.729501:0:5787:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782727849.729504:0:5787:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d56c8fb6000 10000000:01000000:1.0:1782727849.729544:0:5787:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d56c8fb6000 10000000:01000000:1.0:1782727849.729549:0:5787:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782727849.729556:0:5787:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8d56c8fb6000 from 1 10000000:01000000:1.0:1782727849.729558:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782727849.729591:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: 00000000e73b0414/0x22171c6c29614b5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.729599:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: 00000000e73b0414/0x22171c6c29614b5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.729609:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: 00000000e73b0414/0x22171c6c29614b5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727849.729626:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d32f02dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571983360:0@lo:101: 00000100:00100000:1.0:1782727849.729689:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727849.729725:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set 0000000060b28645 going to sleep for 11 seconds 00000100:00100000:1.0:1782727849.729744:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571983360 00000100:00100000:1.0:1782727849.729749:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571983360 00000100:00100000:1.0:1782727849.729776:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782727849.729782:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec2154f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:5787:x1869325571983360:12345-0@lo:101: 00010000:00010000:1.0:1782727849.729794:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727849.729806:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000054037ea1/0x22171c6c29614b62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614b5b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.729842:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000054037ea1/0x22171c6c29614b62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614b5b expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.729851:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000054037ea1/0x22171c6c29614b62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614b5b expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.729860:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000054037ea1, rc 0) 00000100:00100000:1.0:1782727849.729891:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec2154f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:5787:x1869325571983360:12345-0@lo:101: Request processed in 109us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727849.729897:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782727849.729933:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d32f02dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571983360:0@lo:101: 00010000:00010000:1.0:1782727849.729944:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: 00000000e73b0414/0x22171c6c29614b5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614b62 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.729952:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: 00000000e73b0414/0x22171c6c29614b5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614b62 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727849.729994:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d32f02dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571983488:0@lo:501: 00000100:00100000:1.0:1782727849.730025:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727849.730037:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set 0000000060b28645 going to sleep for 11 seconds 00000100:00100000:1.0:1782727849.730049:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571983488 00000100:00100000:1.0:1782727849.730052:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571983488 00000100:00100000:1.0:1782727849.730066:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782727849.730070:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3aec1ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:5787:x1869325571983488:12345-0@lo:501: 00000100:00100000:1.0:1782727849.730299:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3aec1ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:5787:x1869325571983488:12345-0@lo:501: Request processed in 229us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727849.730306:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782727849.730330:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d32f02dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571983488:0@lo:501: 00000100:00100000:1.0:1782727849.730352:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d32f02dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571983616:0@lo:503: 00000100:00100000:1.0:1782727849.730382:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727849.730392:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set 0000000060b28645 going to sleep for 11 seconds 00000100:00100000:1.0:1782727849.730403:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571983616 00000100:00100000:1.0:1782727849.730406:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571983616 00000100:00100000:1.0:1782727849.730419:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782727849.730423:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c660172 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:5787:x1869325571983616:12345-0@lo:503: 00000100:00100000:1.0:1782727849.730762:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c660172 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:5787:x1869325571983616:12345-0@lo:503: Request processed in 337us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727849.730768:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782727849.730804:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d32f02dd pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571983616:0@lo:503: 00000100:00100000:1.0:1782727849.731026:0:5835:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d32f02dd pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5835:1869325571983744:0@lo:502: 00000100:00100000:1.0:1782727849.731059:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727849.731077:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571983744 00000100:00100000:1.0:1782727849.731080:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571983744 00000100:00100000:1.0:1782727849.731097:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782727849.731106:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c24807d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:5835:x1869325571983744:12345-0@lo:502: 00000100:00100000:1.0:1782727849.731268:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c24807d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:5835:x1869325571983744:12345-0@lo:502: Request processed in 161us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727849.731275:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782727849.731301:0:5835:0:(client.c:2701:ptlrpc_set_wait()) set 000000001b0a6dfc going to sleep for 11 seconds 00000100:00100000:1.0:1782727849.731311:0:5835:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d32f02dd pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5835:1869325571983744:0@lo:502: 00000020:01000004:1.0:1782727849.731369:0:5835:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1782727849.731387:0:5835:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000005a6ba99) 00000020:00000080:1.0:1782727849.731408:0:5835:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1782727849.731639:0:5835:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000063780a60 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782727849.731644:0:5835:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000063780a60 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782727849.731648:0:5835:0:(obd_mount.c:701:lustre_put_lsi()) put 0000000063780a60 4 00010000:00080000:1.0:1782727849.731680:0:5835:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000593563d1@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.131@tcp at head 00010000:00010000:1.0:1782727849.739479:0:5835:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1782727849.739634:0:5835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1782727849.739677:0:5835:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782727849.739690:0:5835:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x22171c6c29614b70 00000100:00080000:1.0:1782727849.739701:0:5835:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782727849.739708:0:5835:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000593563d1 using connection 192.168.202.131@tcp/0@lo 00000100:00100000:1.0:1782727849.739745:0:5835:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d32f02dd x1869325571983872/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782727849.739774:0:5835:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1782727849.740025:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d32f02dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869325571983872:0@lo:38: 00000100:00100000:2.0:1782727849.740114:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727849.740229:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571983872 00000100:00100000:0.0:1782727849.740239:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571983872 00000100:00100000:0.0:1782727849.740282:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782727849.740290:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072c1d8b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1869325571983872:12345-0@lo:38: 00000100:00100000:0.0:1782727849.740350:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072c1d8b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1869325571983872:12345-0@lo:38: Request processed in 59us (235us total) trans 0 rc -11/-11 00000100:00100000:0.0:1782727849.740357:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782727849.740416:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782727849.740429:0:3313:0:(import.c:65:import_set_state_nolock()) 00000000593563d1 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782727849.740434:0:3313:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1782727849.740437:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d32f02dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869325571983872:0@lo:38: 00000100:00100000:0.0:1782727849.741353:0:5835:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001622767f pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5835:1869325571984000:0@lo:502: 00000100:00100000:0.0:1782727849.741418:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727849.743016:0:5835:0:(client.c:2701:ptlrpc_set_wait()) set 000000006b81ef60 going to sleep for 11 seconds 00000100:00100000:2.0:1782727849.743186:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571984000 00000100:00100000:2.0:1782727849.743195:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571984000 00000100:00100000:2.0:1782727849.743249:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782727849.743258:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049ca8c58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:5835:x1869325571984000:12345-0@lo:502: 00000100:00100000:2.0:1782727849.743694:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049ca8c58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:5835:x1869325571984000:12345-0@lo:502: Request processed in 434us (2273us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727849.743714:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782727849.743928:0:5835:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001622767f pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5835:1869325571984000:0@lo:502: 00000040:00080000:0.0:1782727849.743966:0:5835:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1782727849.744143:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1782727849.744162:0:5787:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782727849.744213:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: 00000000e73b0414/0x22171c6c29614b5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614b62 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.744224:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: 00000000e73b0414/0x22171c6c29614b5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614b62 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1782727849.744278:0:5787:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1782727849.744281:0:5787:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782727849.744282:0:5787:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727849.744283:0:5787:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782727849.744285:0:5787:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727849.744286:0:5787:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727849.744288:0:5787:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782727849.744289:0:5787:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782727849.744291:0:5787:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782727849.744292:0:5787:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782727849.744293:0:5787:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727849.744295:0:5787:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782727849.744299:0:5787:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1782727849.744302:0:5787:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782727849.744303:0:5787:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782727849.744304:0:5787:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727849.744306:0:5787:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782727849.744307:0:5787:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727849.744308:0:5787:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727849.744309:0:5787:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782727849.744310:0:5787:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782727849.744311:0:5787:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782727849.744312:0:5787:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782727849.744313:0:5787:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727849.744313:0:5787:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782727849.744332:0:5787:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1782727849.744347:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ff04113e pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571984128:0@lo:253: 00000100:00100000:1.0:1782727849.744397:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727849.744437:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set 00000000340bbf45 going to sleep for 11 seconds 00000100:00100000:2.0:1782727849.744481:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571984128 00000100:00100000:2.0:1782727849.744486:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571984128 00000100:00100000:2.0:1782727849.744558:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782727849.744567:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe2ec76b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:5787:x1869325571984128:12345-0@lo:253: 20000000:01000000:2.0:1782727849.744589:0:5801:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1782727849.744606:0:5801:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1782727849.772761:0:5801:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1782727849.772780:0:5801:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1782727849.772799:0:5823:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1782727849.772804:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1782727849.772839:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000df9cd55b/0x22171c6c29614b77 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.772865:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000062fd5dc2/0x22171c6c29614b46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614b3f expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.772875:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000df9cd55b/0x22171c6c29614b77 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.772921:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000062fd5dc2/0x22171c6c29614b46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22171c6c29614b3f expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.772950:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000062fd5dc2/0x22171c6c29614b46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22171c6c29614b3f expref: 12 pid: 5798 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727849.772966:0:5823:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000021a9f3eb pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1869325571984256:0@lo:104: 00000100:00100000:3.0:1782727849.773041:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727849.773101:0:5823:0:(client.c:2701:ptlrpc_set_wait()) set 000000006f651e68 going to sleep for 11 seconds 00000100:00100000:3.0:1782727849.774688:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571984256 00000100:00100000:3.0:1782727849.774705:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571984256 00000100:00100000:3.0:1782727849.774768:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782727849.774778:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005603c0b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+3:5823:x1869325571984256:12345-0@lo:104: 00010000:00010000:3.0:1782727849.774799:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: 000000001732336f/0x22171c6c29614b3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614b46 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727849.774919:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782727849.774925:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005603c0b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+3:5823:x1869325571984256:12345-0@lo:104: Request processed in 149us (1885us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727849.774933:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782727849.775009:0:5823:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000021a9f3eb pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1869325571984256:0@lo:104: 00010000:00010000:3.0:1782727849.775030:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000df9cd55b/0x22171c6c29614b77 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.775225:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782727849.775231:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: 000000001732336f/0x22171c6c29614b3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614b46 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.775239:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001732336f already unused, calling callback (000000007f5cd553) 10000000:00010000:1.0:1782727849.775242:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: 000000001732336f/0x22171c6c29614b3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x22171c6c29614b46 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.775266:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: 000000001732336f/0x22171c6c29614b3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x22171c6c29614b46 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727849.775272:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: 000000001732336f/0x22171c6c29614b3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x22171c6c29614b46 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727849.775277:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782727849.775312:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: 000000001732336f/0x22171c6c29614b3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614b46 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.775318:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782727849.775336:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: 000000001732336f/0x22171c6c29614b3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614b46 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.775342:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: 000000001732336f/0x22171c6c29614b3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614b46 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.775357:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727849.775359:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727849.775360:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727849.775427:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000035ffa1e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3315:1869325571984384:0@lo:103: 00000100:00100000:1.0:1782727849.775467:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727849.775571:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571984384 00000100:00100000:1.0:1782727849.775575:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571984384 00010000:00010000:1.0:1782727849.775592:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000062fd5dc2/0x22171c6c29614b46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614b3f expref: 13 pid: 5798 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727849.775612:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782727849.775616:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040b6149c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:3315:x1869325571984384:12345-0@lo:103: 00010000:00010000:1.0:1782727849.775632:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727849.775637:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000062fd5dc2/0x22171c6c29614b46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614b3f expref: 13 pid: 5798 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.775647:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000062fd5dc2/0x22171c6c29614b46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22171c6c29614b3f expref: 13 pid: 5798 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.775661:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000062fd5dc2/0x22171c6c29614b46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22171c6c29614b3f expref: 13 pid: 5798 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.775676:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000df9cd55b/0x22171c6c29614b77 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.775684:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df9cd55b/0x22171c6c29614b77 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782727849.775700:0:5791:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002897499s 00010000:00010000:1.0:1782727849.775703:0:5791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000df9cd55b/0x22171c6c29614b77 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.775710:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000df9cd55b/0x22171c6c29614b77 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.775716:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000df9cd55b/0x22171c6c29614b77 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.775721:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000df9cd55b/0x22171c6c29614b77 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.775727:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000df9cd55b already unused, calling callback (0000000058dcbfca) 00010000:00010000:1.0:1782727849.775730:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000df9cd55b/0x22171c6c29614b77 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.775742:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000df9cd55b/0x22171c6c29614b77 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.775754:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000df9cd55b/0x22171c6c29614b77 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.775762:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727849.775786:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040b6149c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:3315:x1869325571984384:12345-0@lo:103: Request processed in 170us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727849.775793:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782727849.775950:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000035ffa1e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3315:1869325571984384:0@lo:103: 00010000:00010000:1.0:1782727849.775966:0:5823:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000df9cd55b/0x22171c6c29614b77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.775971:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000df9cd55b/0x22171c6c29614b77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727849.775977:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000df9cd55b/0x22171c6c29614b77 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727849.780650:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe2ec76b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:5787:x1869325571984128:12345-0@lo:253: Request processed in 36074us (36242us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727849.780670:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782727849.780766:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ff04113e pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5787:1869325571984128:0@lo:253: 10000000:01000000:1.0:1782727849.780784:0:5787:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1782727849.780788:0:5787:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782727849.780790:0:5787:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782727849.780791:0:5787:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727849.780793:0:5787:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782727849.780794:0:5787:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727849.780796:0:5787:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727849.780797:0:5787:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782727849.780799:0:5787:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782727849.780882:0:5787:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782727849.780883:0:5787:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782727849.780885:0:5787:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727849.780887:0:5787:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1782727849.780907:0:5787:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1782727849.785710:0:5787:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1782727849.786096:0:5787:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1782727849.786291:0:5787:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1782727849.786461:0:5787:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1782727849.786696:0:5787:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1782727849.786845:0:5787:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1782727849.788091:0:5787:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1782727849.788298:0:5787:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1782727849.788748:0:5787:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1782727849.789018:0:5787:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1782727849.789217:0:5787:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1782727849.789390:0:5787:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1782727849.826227:0:5787:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1782727849.853463:0:5787:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1782727849.853807:0:5841:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1782727849.856193:0:5787:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1782727849.856340:0:5787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1782727849.856832:0:5787:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1782727849.856841:0:5787:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1782727849.856974:0:5787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1782727849.858584:0:5840:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1782727849.858593:0:5840:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:3.0:1782727849.859114:0:5787:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1782727849.864216:0:5787:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1782727849.864296:0:5787:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1782727849.865090:0:5787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1782727849.865415:0:5787:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1782727849.866954:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1782727849.867104:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1782727849.867232:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1782727849.867364:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1782727849.867479:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1782727849.868012:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1782727849.868171:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1782727849.868360:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1782727849.872795:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1782727849.873079:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1782727849.873231:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1782727849.873378:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1782727849.873755:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1782727849.873921:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1782727849.874080:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1782727849.874233:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1782727849.874988:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1782727849.875254:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1782727849.875419:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1782727849.875738:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1782727849.875993:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1782727849.876166:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1782727849.876326:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1782727849.877985:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1782727849.878207:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1782727849.878328:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1782727849.878469:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1782727849.880004:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1782727849.880201:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1782727849.880335:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1782727849.880625:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1782727849.880791:0:5787:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1782727849.881031:0:5787:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1782727849.908122:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1782727849.960006:0:5787:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1782727849.960047:0:5787:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaab7c1c7b988 00100000:10000000:1.0:1782727849.960056:0:5787:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00010000:00010000:0.0:1782727849.967425:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1782727849.969483:0:5787:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782727849.969500:0:5787:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.131@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782727849.969538:0:5787:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1782727849.969559:0:5787:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1782727849.999432:0:5841:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1782727849.999559:0:5841:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1782727849.999564:0:5841:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1782727850.989928:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727852.018019:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727853.041139:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727854.067275:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782727854.997415:0:6083:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1782727855.085652:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782727855.214350:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1782727855.214359:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1782727855.214362:0:8:0:(import.c:65:import_set_state_nolock()) 00000000593563d1 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782727855.214374:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000593563d1 using connection 192.168.202.131@tcp/0@lo 00000100:00100000:1.0:1782727855.214398:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000035ffa1e2 x1869325571984640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782727855.215378:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ff04113e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325571984512:0@lo:400: 00000100:00100000:2.0:1782727855.215603:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727855.217226:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571984512 00000100:00100000:3.0:1782727855.217239:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571984512 00000100:00100000:3.0:1782727855.217296:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782727855.219737:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000357517fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:3316:x1869325571984512:12345-0@lo:400: 00000100:00100000:3.0:1782727855.220569:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000357517fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:3316:x1869325571984512:12345-0@lo:400: Request processed in 842us (4966us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727855.220579:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782727855.221400:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ff04113e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325571984512:0@lo:400: 00000100:00100000:0.0:1782727855.222274:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000035ffa1e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869325571984640:0@lo:38: 00000100:00100000:0.0:1782727855.223967:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727855.224010:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571984640 00000100:00100000:1.0:1782727855.224018:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571984640 00000100:00100000:1.0:1782727855.224862:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782727855.224869:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001622767f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1869325571984640:12345-0@lo:38: 00010000:00080000:1.0:1782727855.224902:0:5808:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:1.0:1782727855.224938:0:5808:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x22171c6c29614b7e 00000004:00100000:1.0:1782727855.224979:0:5808:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782727855.225088:0:5808:0:(import.c:65:import_set_state_nolock()) 000000007068f731 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782727855.225158:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001622767f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869325571984640:12345-0@lo:38: Request processed in 288us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727855.225166:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782727855.225713:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000035ffa1e2 x1869325571984640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782727865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782727855.225730:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1782727855.225737:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1782727855.226433:0:3313:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782727855.226437:0:3313:0:(import.c:65:import_set_state_nolock()) 00000000593563d1 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782727855.226446:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000035ffa1e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869325571984640:0@lo:38: 00010000:00010000:3.0:1782727856.110009:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727857.134738:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727858.167024:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782727858.285626:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782727858.285637:0:5803:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8d56c8fb6000 from 3 10000000:01000000:2.0:1782727858.285643:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782727858.285701:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: 00000000fb6b96a3/0x22171c6c29614b85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727858.285716:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: 00000000fb6b96a3/0x22171c6c29614b85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727858.285727:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: 00000000fb6b96a3/0x22171c6c29614b85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727858.285755:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e9f528b9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571984768:0@lo:101: 00000100:00100000:2.0:1782727858.285845:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727858.285911:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d12146ec going to sleep for 11 seconds 00000100:00100000:3.0:1782727858.285973:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571984768 00000100:00100000:3.0:1782727858.285982:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571984768 00000100:00100000:3.0:1782727858.286042:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782727858.286050:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000353e9f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:5803:x1869325571984768:12345-0@lo:101: 00010000:00010000:3.0:1782727858.286065:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727858.286088:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009a0e724f/0x22171c6c29614b8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614b85 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727858.286115:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009a0e724f/0x22171c6c29614b8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614b85 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727858.286126:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009a0e724f/0x22171c6c29614b8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614b85 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727858.286135:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009a0e724f, rc 0) 00000100:00100000:3.0:1782727858.286192:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000353e9f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:5803:x1869325571984768:12345-0@lo:101: Request processed in 142us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727858.286199:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782727858.286303:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e9f528b9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571984768:0@lo:101: 00010000:00010000:1.0:1782727858.286319:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: 00000000fb6b96a3/0x22171c6c29614b85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614b8c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727858.286327:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: 00000000fb6b96a3/0x22171c6c29614b85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614b8c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727858.286383:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c8474b72 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571984896:0@lo:256: 00000100:00100000:1.0:1782727858.286425:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727858.286460:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set 000000001b0a6dfc going to sleep for 11 seconds 00000100:00100000:3.0:1782727858.286503:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571984896 00000100:00100000:3.0:1782727858.286535:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571984896 00000100:00100000:3.0:1782727858.286559:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782727858.286564:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c2207b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:5803:x1869325571984896:12345-0@lo:256: 20000000:01000000:3.0:1782727858.286580:0:5798:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782727858.286599:0:5798:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782727858.286603:0:5798:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1782727858.286688:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c2207b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:5803:x1869325571984896:12345-0@lo:256: Request processed in 123us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727858.286695:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782727858.286727:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c8474b72 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571984896:0@lo:256: 10000000:01000000:3.0:1782727858.286777:0:5803:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782727858.286784:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: 00000000fb6b96a3/0x22171c6c29614b85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614b8c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727858.286792:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: 00000000fb6b96a3/0x22171c6c29614b85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614b8c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727859.181760:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782727859.975874:0:6286:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdeff41290 20000000:00000080:1.0:1782727859.975903:0:6286:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d5700f4bc00 uarg=0000000000000000 20000000:01000000:1.0:1782727859.975952:0:6286:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1782727859.975962:0:6286:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1782727859.975968:0:6286:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1782727859.977582:0:6286:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1782727859.977601:0:6286:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1782727859.980373:0:6286:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782727859.980953:0:6286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1782727859.981020:0:6286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1782727859.981076:0:6286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1782727859.981097:0:6286:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1782727859.981119:0:6286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000231ed504/0x22171c6c29614b93 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727859.981154:0:6286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008df7d94b/0x22171c6c29614b54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614b4d expref: 11 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727859.981163:0:6286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000231ed504/0x22171c6c29614b93 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727859.981212:0:6286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008df7d94b/0x22171c6c29614b54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22171c6c29614b4d expref: 11 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727859.981229:0:6286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008df7d94b/0x22171c6c29614b54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22171c6c29614b4d expref: 11 pid: 5798 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727859.981246:0:6286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000fb0ee435 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6286:1869325571985024:0@lo:104: 00000100:00100000:1.0:1782727859.981340:0:6286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727859.981418:0:6286:0:(client.c:2701:ptlrpc_set_wait()) set 000000005c2995c9 going to sleep for 11 seconds 00000100:00100000:3.0:1782727859.981420:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571985024 00000100:00100000:3.0:1782727859.981428:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571985024 00000100:00100000:3.0:1782727859.981497:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782727859.981506:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002259b8a9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+3:6286:x1869325571985024:12345-0@lo:104: 00010000:00010000:3.0:1782727859.981534:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: 000000004aad4ae2/0x22171c6c29614b4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614b54 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727859.982103:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782727859.982109:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002259b8a9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+3:6286:x1869325571985024:12345-0@lo:104: Request processed in 605us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727859.982118:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1782727859.982186:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782727859.982192:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: 000000004aad4ae2/0x22171c6c29614b4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614b54 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727859.982201:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004aad4ae2 already unused, calling callback (000000007f5cd553) 10000000:00010000:1.0:1782727859.982205:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: 000000004aad4ae2/0x22171c6c29614b4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x22171c6c29614b54 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727859.982214:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: 000000004aad4ae2/0x22171c6c29614b4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x22171c6c29614b54 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727859.982221:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: 000000004aad4ae2/0x22171c6c29614b4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x22171c6c29614b54 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727859.982226:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782727859.982267:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: 000000004aad4ae2/0x22171c6c29614b4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614b54 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727859.982275:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782727859.982328:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000446b9884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3317:1869325571985152:0@lo:103: 00000100:00100000:2.0:1782727859.982379:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782727859.982443:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: 000000004aad4ae2/0x22171c6c29614b4d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614b54 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727859.982450:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: 000000004aad4ae2/0x22171c6c29614b4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614b54 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727859.982480:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727859.982483:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727859.982484:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727859.982496:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571985152 00000100:00100000:1.0:1782727859.982678:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571985152 00010000:00010000:1.0:1782727859.982705:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008df7d94b/0x22171c6c29614b54 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614b4d expref: 12 pid: 5798 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727859.982731:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782727859.982738:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aff2ce08 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:3317:x1869325571985152:12345-0@lo:103: 00010000:00010000:1.0:1782727859.982766:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727859.982771:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008df7d94b/0x22171c6c29614b54 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614b4d expref: 12 pid: 5798 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727859.982782:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008df7d94b/0x22171c6c29614b54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22171c6c29614b4d expref: 12 pid: 5798 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727859.982800:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000231ed504/0x22171c6c29614b93 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727859.982808:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000231ed504/0x22171c6c29614b93 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727859.982822:0:5791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000231ed504/0x22171c6c29614b93 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727859.982829:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000231ed504/0x22171c6c29614b93 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727859.982835:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000231ed504/0x22171c6c29614b93 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727859.982841:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000231ed504/0x22171c6c29614b93 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727859.982845:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000231ed504 already unused, calling callback (0000000058dcbfca) 00010000:00010000:1.0:1782727859.982854:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000231ed504/0x22171c6c29614b93 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727859.982861:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000231ed504/0x22171c6c29614b93 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727859.982869:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000231ed504/0x22171c6c29614b93 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727859.982879:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727859.982982:0:6286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008df7d94b/0x22171c6c29614b54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22171c6c29614b4d expref: 12 pid: 5798 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727859.983005:0:6286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000fb0ee435 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6286:1869325571985024:0@lo:104: 00010000:00010000:0.0:1782727859.983049:0:6286:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000231ed504/0x22171c6c29614b93 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727859.983060:0:6286:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000231ed504/0x22171c6c29614b93 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727859.983066:0:6286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000231ed504/0x22171c6c29614b93 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727859.983071:0:6286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000231ed504/0x22171c6c29614b93 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727859.983725:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aff2ce08 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:3317:x1869325571985152:12345-0@lo:103: Request processed in 985us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727859.983738:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782727859.983849:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000446b9884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3317:1869325571985152:0@lo:103: 00010000:00010000:1.0:1782727860.218156:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727860.338736:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000021a9f3eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325571985280:0@lo:400: 00000100:00100000:3.0:1782727860.338744:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000008e1fcc37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869325571985408:0@lo:400: 00000100:00100000:1.0:1782727860.343133:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727860.343194:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571985280 00000100:00100000:2.0:1782727860.343215:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571985280 00000100:00100000:2.0:1782727860.343278:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782727860.343290:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003963afba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:3314:x1869325571985280:12345-0@lo:400: 00000100:00100000:2.0:1782727860.343387:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003963afba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:3314:x1869325571985280:12345-0@lo:400: Request processed in 100us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727860.343396:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782727860.345582:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000021a9f3eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325571985280:0@lo:400: 00000100:00100000:3.0:1782727860.352147:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727860.352294:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571985408 00000100:00100000:3.0:1782727860.352305:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571985408 00000100:00100000:3.0:1782727860.352362:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782727860.352370:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008bc082ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869325571985408:12345-0@lo:400: 00000100:00100000:3.0:1782727860.352458:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008bc082ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869325571985408:12345-0@lo:400: Request processed in 89us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727860.352466:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1782727860.352538:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008e1fcc37 x1869325571985408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727860.352556:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000008e1fcc37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869325571985408:0@lo:400: 00010000:00010000:3.0:1782727861.240102:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727862.254761:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727863.277838:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727864.301865:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727865.333014:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727865.454215:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000af90b4a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325571985536:0@lo:400: 00000100:00100000:3.0:1782727865.454318:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727865.454407:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727865.454414:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b7af7ade pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869325571985664:0@lo:400: 00000100:00100000:3.0:1782727865.454448:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727865.454782:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571985536 00000100:00100000:1.0:1782727865.454793:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571985536 00000100:00100000:1.0:1782727865.454849:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782727865.454859:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000916b9cfe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:3316:x1869325571985536:12345-0@lo:400: 00000100:00100000:1.0:1782727865.454923:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000916b9cfe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:3316:x1869325571985536:12345-0@lo:400: Request processed in 66us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727865.454932:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782727865.455842:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571985664 00000100:00100000:1.0:1782727865.455850:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571985664 00000100:00100000:1.0:1782727865.455892:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782727865.455899:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e1fcc37 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869325571985664:12345-0@lo:400: 00000100:00100000:1.0:1782727865.455961:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e1fcc37 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869325571985664:12345-0@lo:400: Request processed in 62us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727865.455981:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782727865.456408:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b7af7ade x1869325571985664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727865.456426:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b7af7ade pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869325571985664:0@lo:400: 00000100:00100000:2.0:1782727865.456440:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000af90b4a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325571985536:0@lo:400: 00000020:01000004:0.0:1782727865.689800:0:6602:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1782727865.689805:0:6602:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1782727865.689939:0:6602:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000073332987 00000020:01000004:0.0:1782727865.689962:0:6602:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1782727865.689978:0:6602:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1782727865.690006:0:6602:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000716dd291) 00000020:00000080:0.0:1782727865.690028:0:6602:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1782727865.714272:0:6602:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1782727865.715984:0:6602:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1782727865.749221:0:6602:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1782727865.755113:0:6602:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1782727865.755154:0:6602:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1782727865.755232:0:6602:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1782727865.755261:0:6602:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1782727865.755955:0:6602:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1782727865.755969:0:6602:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782727865.755989:0:6602:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x22171c6c29614ba1 00000020:01000004:2.0:1782727865.755999:0:6602:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1782727865.756034:0:6602:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.131@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1782727865.756038:0:6602:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1782727865.756044:0:6602:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1782727865.756049:0:6602:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1782727865.756062:0:6602:0:(genops.c:413:class_newdev()) Allocate new device OSS (000000007911dc4e) 00000020:00000080:2.0:1782727865.756074:0:6602:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1782727865.757649:0:6602:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782727865.757836:0:6602:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1782727865.757843:0:6602:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1782727865.762469:0:6602:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1782727865.762484:0:6602:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1782727865.763870:0:6602:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1782727865.763879:0:6602:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1782727865.769412:0:6602:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782727865.769760:0:6602:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1782727865.769768:0:6602:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1782727865.771917:0:6602:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1782727865.771930:0:6602:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1782727865.801824:0:6602:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782727865.802090:0:6602:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1782727865.802097:0:6602:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1782727865.807956:0:6602:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1782727865.807980:0:6602:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1782727865.810275:0:6602:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1782727865.810293:0:6602:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1782727865.815889:0:6602:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782727865.816111:0:6602:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1782727865.816119:0:6602:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1782727865.818115:0:6602:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1782727865.818129:0:6602:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1782727865.889236:0:6602:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782727865.889637:0:6602:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1782727865.889644:0:6602:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1782727865.892146:0:6602:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1782727865.892163:0:6602:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1782727865.892899:0:6602:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1782727865.892999:0:6602:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1782727865.893007:0:6602:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.131@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1782727865.927066:0:6602:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.131@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782727865.927111:0:6602:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.131@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1782727865.927115:0:6602:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782727865.927117:0:6602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782727865.927119:0:6602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727865.927120:0:6602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782727865.927121:0:6602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727865.927123:0:6602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727865.927124:0:6602:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782727865.927126:0:6602:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782727865.927131:0:6602:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782727865.927132:0:6602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727865.927133:0:6602:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782727865.927137:0:6602:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1782727865.927139:0:6602:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782727865.927140:0:6602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782727865.927141:0:6602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727865.927142:0:6602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782727865.927143:0:6602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727865.927144:0:6602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727865.927144:0:6602:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782727865.927145:0:6602:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782727865.927146:0:6602:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782727865.927147:0:6602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727865.927147:0:6602:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782727865.927178:0:6602:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1782727865.927199:0:6602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006529cd81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571985792:0@lo:253: 00000100:00100000:0.0:1782727865.927288:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727865.927827:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571985792 00000100:00100000:2.0:1782727865.927837:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571985792 00000100:00100000:2.0:1782727865.927896:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782727865.927903:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e3b91e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:6602:x1869325571985792:12345-0@lo:253: 20000000:01000000:2.0:1782727865.927948:0:5798:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1782727865.927954:0:5798:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1782727865.927960:0:5798:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1782727865.927963:0:5798:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000100:00100000:0.0:1782727865.928887:0:6602:0:(client.c:2701:ptlrpc_set_wait()) set 00000000498254b6 going to sleep for 11 seconds 00000040:00080000:2.0:1782727865.929905:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782727865.930277:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1782727865.930292:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1782727865.930537:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1782727865.930547:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1782727865.930575:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1782727865.930770:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1782727865.931266:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1782727865.931290:0:5798:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.131@tcp 20000000:01000000:2.0:1782727865.931292:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.131@tcp (null) (null) (null) 00000040:00080000:2.0:1782727865.931847:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1782727865.931858:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1782727865.931921:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1782727865.932014:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.131@tcp (null) (null) 00000040:00080000:2.0:1782727865.932055:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1782727865.932066:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1782727865.932092:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1782727865.932139:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1782727865.935407:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1782727865.935455:0:5798:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.131@tcp 20000000:01000000:2.0:1782727865.935458:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.131@tcp (null) (null) (null) 00000040:00080000:2.0:1782727865.935503:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1782727865.935540:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1782727865.935598:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1782727865.936221:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.131@tcp (null) (null) 00000040:00080000:2.0:1782727865.936303:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1782727865.936333:0:5798:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1782727865.936749:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1782727865.936794:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1782727865.936817:0:5798:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1782727865.936821:0:5798:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1782727865.936829:0:5798:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1782727865.936831:0:5798:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1782727865.936833:0:5798:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1782727865.936849:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1782727865.936851:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1782727865.936900:0:5798:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1782727865.936903:0:5798:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1782727865.938142:0:6617:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1782727865.938232:0:6617:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1782727865.938287:0:6617:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1782727865.939131:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1782727865.939178:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1782727865.939208:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1782727865.939220:0:5798:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1782727865.939223:0:5798:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1782727865.942111:0:6618:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1782727865.943099:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1782727865.943150:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1782727865.943247:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1782727865.943262:0:5798:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1782727865.943265:0:5798:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1782727865.946146:0:6619:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1782727865.949081:0:6619:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1782727865.949181:0:6619:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1782727865.955811:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1782727865.955896:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1782727865.955978:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:3.0:1782727865.956006:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1782727865.956027:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000869a148c/0x22171c6c29614baf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727865.956050:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001a037b55/0x22171c6c29614ad6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614acf expref: 11 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727865.956069:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b5ce7bdc/0x22171c6c29614af2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614aeb expref: 11 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727865.956076:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000054037ea1/0x22171c6c29614b62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614b5b expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727865.956083:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000869a148c/0x22171c6c29614baf lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727865.956125:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000054037ea1/0x22171c6c29614b62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22171c6c29614b5b expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727865.956144:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000054037ea1/0x22171c6c29614b62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22171c6c29614b5b expref: 11 pid: 5801 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727865.956160:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000022f2c639 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5798:1869325571985920:0@lo:104: 00000100:00100000:3.0:1782727865.956242:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782727865.956463:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b5ce7bdc/0x22171c6c29614af2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22171c6c29614aeb expref: 11 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727865.956471:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b5ce7bdc/0x22171c6c29614af2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22171c6c29614aeb expref: 11 pid: 5800 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727865.956480:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000158f0608 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5798:1869325571986048:0@lo:104: 00000100:00100000:3.0:1782727865.956502:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782727865.956982:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001a037b55/0x22171c6c29614ad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22171c6c29614acf expref: 11 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727865.956992:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001a037b55/0x22171c6c29614ad6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22171c6c29614acf expref: 11 pid: 5800 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727865.957007:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004c544111 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5798:1869325571986176:0@lo:104: 00000100:00100000:3.0:1782727865.957030:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727865.957080:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571985920 00000100:00100000:2.0:1782727865.957089:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571985920 00000100:00100000:2.0:1782727865.957141:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571986048 00000100:00100000:2.0:1782727865.957143:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571986048 00000100:00100000:2.0:1782727865.957157:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782727865.957166:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0e15db2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+4:5798:x1869325571985920:12345-0@lo:104: 00010000:00010000:2.0:1782727865.957179:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: 00000000e73b0414/0x22171c6c29614b5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614b62 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727865.957236:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782727865.957242:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0e15db2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+4:5798:x1869325571985920:12345-0@lo:104: Request processed in 77us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727865.957249:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782727865.957268:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782727865.957273:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd9ae742 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+3:5798:x1869325571986048:12345-0@lo:104: 00010000:00010000:2.0:1782727865.957279:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: 00000000c9ae75f4/0x22171c6c29614aeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614af2 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727865.957938:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782727865.957947:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd9ae742 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+3:5798:x1869325571986048:12345-0@lo:104: Request processed in 673us (1443us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727865.957955:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1782727865.957981:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782727865.957986:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: 00000000e73b0414/0x22171c6c29614b5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614b62 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727865.957993:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e73b0414 already unused, calling callback (000000007f5cd553) 10000000:00010000:2.0:1782727865.958006:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: 00000000e73b0414/0x22171c6c29614b5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x22171c6c29614b62 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727865.958015:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: 00000000e73b0414/0x22171c6c29614b5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x22171c6c29614b62 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782727865.958023:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: 00000000e73b0414/0x22171c6c29614b5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x22171c6c29614b62 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727865.958029:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782727865.958066:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: 00000000e73b0414/0x22171c6c29614b5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614b62 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727865.958074:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782727865.958096:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: 00000000e73b0414/0x22171c6c29614b5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614b62 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727865.958103:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: 00000000e73b0414/0x22171c6c29614b5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614b62 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727865.958122:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782727865.958124:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: 00000000c9ae75f4/0x22171c6c29614aeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614af2 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727865.958130:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c9ae75f4 already unused, calling callback (000000007f5cd553) 10000000:00010000:2.0:1782727865.958132:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: 00000000c9ae75f4/0x22171c6c29614aeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x22171c6c29614af2 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727865.958139:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: 00000000c9ae75f4/0x22171c6c29614aeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x22171c6c29614af2 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782727865.958156:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: 00000000c9ae75f4/0x22171c6c29614aeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x22171c6c29614af2 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727865.958161:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782727865.958174:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: 00000000c9ae75f4/0x22171c6c29614aeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614af2 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727865.958179:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782727865.958183:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: 00000000c9ae75f4/0x22171c6c29614aeb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614af2 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727865.958189:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: 00000000c9ae75f4/0x22171c6c29614aeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614af2 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727865.958200:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727865.958202:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727865.958203:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727865.958210:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727865.958234:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000380f52ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325571986304:0@lo:103: 00000100:00100000:2.0:1782727865.958285:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727865.958591:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c23fa4a2 going to sleep for 11 seconds 00000100:00100000:3.0:1782727865.958697:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000022f2c639 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5798:1869325571985920:0@lo:104: 00000100:00100000:3.0:1782727865.958710:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000158f0608 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5798:1869325571986048:0@lo:104: 00000100:00100000:1.0:1782727865.958803:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571986176 00000100:00100000:1.0:1782727865.958810:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571986176 00000100:00100000:1.0:1782727865.958850:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782727865.958857:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000288bd8f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+3:5798:x1869325571986176:12345-0@lo:104: 00010000:00010000:1.0:1782727865.958867:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: 000000000b6b0130/0x22171c6c29614acf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614ad6 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727865.958919:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782727865.958924:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000288bd8f6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+3:5798:x1869325571986176:12345-0@lo:104: Request processed in 68us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727865.958931:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1782727865.958950:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782727865.958953:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: 000000000b6b0130/0x22171c6c29614acf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614ad6 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727865.958971:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000b6b0130 already unused, calling callback (000000007f5cd553) 10000000:00010000:1.0:1782727865.958974:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: 000000000b6b0130/0x22171c6c29614acf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x22171c6c29614ad6 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727865.958980:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: 000000000b6b0130/0x22171c6c29614acf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x22171c6c29614ad6 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727865.958986:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: 000000000b6b0130/0x22171c6c29614acf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x22171c6c29614ad6 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727865.958991:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782727865.959013:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: 000000000b6b0130/0x22171c6c29614acf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614ad6 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727865.959019:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782727865.959035:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: 000000000b6b0130/0x22171c6c29614acf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614ad6 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727865.959042:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: 000000000b6b0130/0x22171c6c29614acf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614ad6 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727865.959060:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727865.959062:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727865.959063:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727865.959080:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b736b162 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325571986560:0@lo:103: 00000100:00100000:1.0:1782727865.959111:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727865.959150:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571986304 00000100:00100000:1.0:1782727865.959154:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571986304 00010000:00010000:1.0:1782727865.959173:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000054037ea1/0x22171c6c29614b62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614b5b expref: 12 pid: 5801 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727865.959199:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571986560 00000100:00100000:1.0:1782727865.959202:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571986560 00010000:00010000:1.0:1782727865.959214:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001a037b55/0x22171c6c29614ad6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614acf expref: 13 pid: 5800 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727865.959226:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782727865.959231:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c6c09ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:3314:x1869325571986304:12345-0@lo:103: 00010000:00010000:1.0:1782727865.959241:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727865.959246:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000054037ea1/0x22171c6c29614b62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614b5b expref: 13 pid: 5801 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727865.959255:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000054037ea1/0x22171c6c29614b62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22171c6c29614b5b expref: 13 pid: 5801 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727865.959267:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000054037ea1/0x22171c6c29614b62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22171c6c29614b5b expref: 13 pid: 5801 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727865.959280:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727865.959303:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c6c09ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:3314:x1869325571986304:12345-0@lo:103: Request processed in 73us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727865.959722:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004c544111 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5798:1869325571986176:0@lo:104: 00010000:00010000:3.0:1782727865.959749:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000869a148c/0x22171c6c29614baf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727865.959856:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000380f52ab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325571986304:0@lo:103: 00000100:00100000:2.0:1782727865.959873:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727865.959879:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f757f087 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325571986432:0@lo:103: 00000100:00100000:2.0:1782727865.959909:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727865.959947:0:5793:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1782727865.959955:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1782727865.960220:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571986432 00000100:00100000:2.0:1782727865.960224:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571986432 00010000:00010000:2.0:1782727865.960246:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b5ce7bdc/0x22171c6c29614af2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614aeb expref: 13 pid: 5800 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727865.960262:0:5793:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1782727865.960264:0:5792:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1782727865.960269:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782727865.960275:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fddd0fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:3316:x1869325571986560:12345-0@lo:103: 00010000:00010000:2.0:1782727865.960285:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727865.960289:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001a037b55/0x22171c6c29614ad6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614acf expref: 13 pid: 5800 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727865.960298:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001a037b55/0x22171c6c29614ad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22171c6c29614acf expref: 13 pid: 5800 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727865.960795:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782727865.960815:0:5791:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1782727865.960822:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782727865.960828:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000380f52ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:3314:x1869325571986432:12345-0@lo:103: 00010000:00010000:1.0:1782727865.960837:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727865.960840:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b5ce7bdc/0x22171c6c29614af2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614aeb expref: 12 pid: 5800 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727865.961150:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001a037b55/0x22171c6c29614ad6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22171c6c29614acf expref: 12 pid: 5800 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727865.961184:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b5ce7bdc/0x22171c6c29614af2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22171c6c29614aeb expref: 11 pid: 5800 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727865.961196:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b5ce7bdc/0x22171c6c29614af2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22171c6c29614aeb expref: 11 pid: 5800 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727865.961221:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000869a148c/0x22171c6c29614baf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727865.961229:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000869a148c/0x22171c6c29614baf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727865.961245:0:5791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000869a148c/0x22171c6c29614baf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727865.961253:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000869a148c/0x22171c6c29614baf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727865.961259:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000869a148c/0x22171c6c29614baf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727865.961266:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000869a148c/0x22171c6c29614baf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727865.961272:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000869a148c already unused, calling callback (0000000058dcbfca) 00010000:00010000:1.0:1782727865.961275:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000869a148c/0x22171c6c29614baf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727865.961282:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000869a148c/0x22171c6c29614baf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727865.961302:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000869a148c/0x22171c6c29614baf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727865.961413:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782727865.961598:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fddd0fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+10:3316:x1869325571986560:12345-0@lo:103: Request processed in 1322us (2487us total) trans 0 rc 0/0 00010000:00010000:3.0:1782727865.961692:0:5798:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000869a148c/0x22171c6c29614baf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727865.961701:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000869a148c/0x22171c6c29614baf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782727865.961710:0:5798:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:1.0:1782727865.961773:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000869a148c/0x22171c6c29614baf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727865.961790:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727865.961830:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000380f52ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+10:3314:x1869325571986432:12345-0@lo:103: Request processed in 1003us (1921us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727865.961837:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782727865.961877:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782727865.961938:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f757f087 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325571986432:0@lo:103: 00000100:00100000:0.0:1782727865.962076:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b736b162 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325571986560:0@lo:103: 00000100:00100000:0.0:1782727866.015065:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e3b91e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+8:6602:x1869325571985792:12345-0@lo:253: Request processed in 87151us (87765us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727866.015087:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782727866.015208:0:6602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006529cd81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571985792:0@lo:253: 10000000:01000000:1.0:1782727866.015225:0:6602:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1782727866.015229:0:6602:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782727866.015231:0:6602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782727866.015232:0:6602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727866.015233:0:6602:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1782727866.015235:0:6602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727866.015236:0:6602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727866.015238:0:6602:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782727866.015239:0:6602:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1782727866.015241:0:6602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727866.015242:0:6602:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1782727866.015264:0:6602:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000073332987 from lustre-OST0000 10000000:01000000:1.0:1782727866.015292:0:6602:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1782727866.015295:0:6602:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1782727866.015303:0:6602:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d56d0964d70 local copy 10000000:01000000:1.0:1782727866.015374:0:6602:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1782727866.015425:0:6602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: 0000000054037ea1/0x22171c6c29614bb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727866.015436:0:6602:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.131@tcp lock: 0000000054037ea1/0x22171c6c29614bb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727866.015459:0:6602:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: 0000000054037ea1/0x22171c6c29614bb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727866.015482:0:6602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e6e1d27c pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571986688:0@lo:101: 00000100:00100000:1.0:1782727866.015556:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727866.015702:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571986688 00000100:00100000:2.0:1782727866.015710:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571986688 00000100:00100000:2.0:1782727866.015747:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782727866.015755:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5dbf060 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+8:6602:x1869325571986688:12345-0@lo:101: 00010000:00010000:2.0:1782727866.015768:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727866.015784:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000364f00c7/0x22171c6c29614bbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614bb6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727866.015807:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000364f00c7/0x22171c6c29614bbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614bb6 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727866.015828:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000364f00c7/0x22171c6c29614bbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614bb6 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727866.015838:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000364f00c7, rc 0) 00000100:00100000:2.0:1782727866.015867:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5dbf060 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+9:6602:x1869325571986688:12345-0@lo:101: Request processed in 113us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727866.015873:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782727866.015990:0:6602:0:(client.c:2701:ptlrpc_set_wait()) set 000000007ba9dbed going to sleep for 11 seconds 00000100:00100000:1.0:1782727866.016005:0:6602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e6e1d27c pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571986688:0@lo:101: 00010000:00010000:1.0:1782727866.016016:0:6602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: 0000000054037ea1/0x22171c6c29614bb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x22171c6c29614bbd expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727866.016023:0:6602:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: 0000000054037ea1/0x22171c6c29614bb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x22171c6c29614bbd expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727866.016151:0:6602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e6e1d27c pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571986816:0@lo:501: 00000100:00100000:1.0:1782727866.016175:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727866.016190:0:6602:0:(client.c:2701:ptlrpc_set_wait()) set 000000007ba9dbed going to sleep for 11 seconds 00000100:00100000:0.0:1782727866.016259:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571986816 00000100:00100000:0.0:1782727866.016263:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571986816 00000100:00100000:0.0:1782727866.016294:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782727866.016300:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be9a69b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+9:6602:x1869325571986816:12345-0@lo:501: 00000100:00100000:0.0:1782727866.016551:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be9a69b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+9:6602:x1869325571986816:12345-0@lo:501: Request processed in 251us (375us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782727866.016563:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782727866.016845:0:6602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e6e1d27c pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571986816:0@lo:501: 10000000:01000000:1.0:1782727866.016859:0:6602:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1782727866.016888:0:6602:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1782727866.016892:0:6602:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: 0000000054037ea1/0x22171c6c29614bb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x22171c6c29614bbd expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727866.016899:0:6602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: 0000000054037ea1/0x22171c6c29614bb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x22171c6c29614bbd expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727866.016906:0:6602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.131@tcp lock: 0000000054037ea1/0x22171c6c29614bb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x22171c6c29614bbd expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727866.016932:0:6602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1782727866.016956:0:6602:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d56c75cf800 10000000:01000000:1.0:1782727866.016961:0:6602:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1782727866.016966:0:6602:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d56d0964d70 10000000:01000000:1.0:1782727866.016968:0:6602:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1782727866.016972:0:6602:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8d56d0964d70 from 1 10000000:01000000:1.0:1782727866.016974:0:6602:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782727866.016996:0:6602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: 000000003e85ce26/0x22171c6c29614bc4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727866.017003:0:6602:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: 000000003e85ce26/0x22171c6c29614bc4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727866.017011:0:6602:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: 000000003e85ce26/0x22171c6c29614bc4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727866.017023:0:6602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e6e1d27c pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571986944:0@lo:101: 00000100:00100000:1.0:1782727866.017051:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727866.017079:0:6602:0:(client.c:2701:ptlrpc_set_wait()) set 000000008996561f going to sleep for 11 seconds 00010000:00010000:2.0:1782727866.017135:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782727866.017140:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: 0000000054037ea1/0x22171c6c29614bb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x22171c6c29614bbd expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727866.017148:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000054037ea1 already unused, calling callback (000000007f5cd553) 10000000:00010000:2.0:1782727866.017151:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: 0000000054037ea1/0x22171c6c29614bb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x22171c6c29614bbd expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727866.017159:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: 0000000054037ea1/0x22171c6c29614bb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x22171c6c29614bbd expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782727866.017166:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: 0000000054037ea1/0x22171c6c29614bb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x22171c6c29614bbd expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727866.017172:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782727866.017190:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: 0000000054037ea1/0x22171c6c29614bb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x22171c6c29614bbd expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727866.017195:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782727866.017218:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: 0000000054037ea1/0x22171c6c29614bb6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x22171c6c29614bbd expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727866.017234:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: 0000000054037ea1/0x22171c6c29614bb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x22171c6c29614bbd expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727866.017249:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727866.017250:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727866.017252:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727866.017291:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c588949a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3317:1869325571987072:0@lo:103: 00000100:00100000:1.0:1782727866.017391:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727866.017468:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571987072 00000100:00100000:2.0:1782727866.017473:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571987072 00000100:00100000:2.0:1782727866.017560:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782727866.017568:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6bc82d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+9:3317:x1869325571987072:12345-0@lo:103: 00010000:00010000:2.0:1782727866.017582:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727866.017595:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000364f00c7/0x22171c6c29614bbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22171c6c29614bb6 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727866.017686:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782727866.017724:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6bc82d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+8:3317:x1869325571987072:12345-0@lo:103: Request processed in 157us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727866.017731:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782727866.017852:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c588949a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3317:1869325571987072:0@lo:103: 00000100:00100000:0.0:1782727866.017918:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571986944 00000100:00100000:0.0:1782727866.017923:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571986944 00000100:00100000:0.0:1782727866.017956:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782727866.017962:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7ac0265 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+8:6602:x1869325571986944:12345-0@lo:101: 00010000:00010000:0.0:1782727866.017973:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727866.017986:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003984e95b/0x22171c6c29614bcb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614bc4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727866.018005:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003984e95b/0x22171c6c29614bcb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614bc4 expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727866.018015:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003984e95b/0x22171c6c29614bcb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614bc4 expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727866.018022:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003984e95b, rc 0) 00000100:00100000:0.0:1782727866.018057:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7ac0265 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+9:6602:x1869325571986944:12345-0@lo:101: Request processed in 96us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727866.018062:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782727866.018138:0:6602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e6e1d27c pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571986944:0@lo:101: 00010000:00010000:1.0:1782727866.018151:0:6602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: 000000003e85ce26/0x22171c6c29614bc4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614bcb expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727866.018160:0:6602:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: 000000003e85ce26/0x22171c6c29614bc4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614bcb expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727866.018186:0:6602:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782727866.018201:0:6602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: 000000003e85ce26/0x22171c6c29614bc4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614bcb expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727866.018208:0:6602:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: 000000003e85ce26/0x22171c6c29614bc4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614bcb expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727866.018215:0:6602:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1782727866.018219:0:6602:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782727866.018224:0:6602:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1782727866.018226:0:6602:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1782727866.018242:0:6602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: 000000001732336f/0x22171c6c29614bd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727866.018249:0:6602:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: 000000001732336f/0x22171c6c29614bd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727866.018255:0:6602:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: 000000001732336f/0x22171c6c29614bd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727866.018268:0:6602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e6e1d27c pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571987200:0@lo:101: 00000100:00100000:1.0:1782727866.018291:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727866.018389:0:6602:0:(client.c:2701:ptlrpc_set_wait()) set 000000008996561f going to sleep for 11 seconds 00000100:00100000:1.0:1782727866.018408:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571987200 00000100:00100000:1.0:1782727866.018412:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571987200 00000100:00100000:1.0:1782727866.018435:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782727866.018440:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4c4cc17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+9:6602:x1869325571987200:12345-0@lo:101: 00010000:00010000:1.0:1782727866.018447:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727866.018459:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e73b0414/0x22171c6c29614bd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614bd2 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727866.018471:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e73b0414/0x22171c6c29614bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614bd2 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727866.018479:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e73b0414/0x22171c6c29614bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614bd2 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727866.018485:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e73b0414, rc 0) 00000100:00100000:1.0:1782727866.018539:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4c4cc17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+10:6602:x1869325571987200:12345-0@lo:101: Request processed in 99us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727866.018545:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782727866.018576:0:6602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e6e1d27c pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571987200:0@lo:101: 00010000:00010000:1.0:1782727866.018585:0:6602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: 000000001732336f/0x22171c6c29614bd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614bd9 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727866.018591:0:6602:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: 000000001732336f/0x22171c6c29614bd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614bd9 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727866.018809:0:6602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e6e1d27c pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571987328:0@lo:501: 00000100:00100000:1.0:1782727866.018832:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727866.018844:0:6602:0:(client.c:2701:ptlrpc_set_wait()) set 000000008996561f going to sleep for 11 seconds 00000100:00100000:1.0:1782727866.018856:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571987328 00000100:00100000:1.0:1782727866.018859:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571987328 00000100:00100000:1.0:1782727866.018872:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782727866.018877:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0889b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+10:6602:x1869325571987328:12345-0@lo:501: 00000100:00100000:1.0:1782727866.019116:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0889b4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+10:6602:x1869325571987328:12345-0@lo:501: Request processed in 238us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727866.019136:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782727866.019169:0:6602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e6e1d27c pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571987328:0@lo:501: 00000100:00100000:1.0:1782727866.019198:0:6602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e6e1d27c pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571987456:0@lo:503: 00000100:00100000:1.0:1782727866.019233:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727866.019247:0:6602:0:(client.c:2701:ptlrpc_set_wait()) set 000000001d4cde60 going to sleep for 11 seconds 00000100:00100000:1.0:1782727866.019261:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571987456 00000100:00100000:1.0:1782727866.019264:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571987456 00000100:00100000:1.0:1782727866.019280:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782727866.019284:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000afd05605 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+10:6602:x1869325571987456:12345-0@lo:503: 00000100:00100000:1.0:1782727866.020247:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000afd05605 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+10:6602:x1869325571987456:12345-0@lo:503: Request processed in 959us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727866.020258:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782727866.020503:0:6602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e6e1d27c pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571987456:0@lo:503: 00000040:00080000:1.0:1782727866.021218:0:6602:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782727866.021297:0:6602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004ef8791b pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571987584:0@lo:502: 00000100:00100000:1.0:1782727866.021446:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727866.021566:0:6602:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e495c0e7 going to sleep for 11 seconds 00000100:00100000:0.0:1782727866.021777:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571987584 00000100:00100000:0.0:1782727866.021784:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571987584 00000100:00100000:0.0:1782727866.021858:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782727866.021865:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0b4c379 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+10:6602:x1869325571987584:12345-0@lo:502: 00000100:00100000:0.0:1782727866.022067:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0b4c379 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+10:6602:x1869325571987584:12345-0@lo:502: Request processed in 202us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727866.022075:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782727866.022165:0:6602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004ef8791b pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571987584:0@lo:502: 00000040:00080000:1.0:1782727866.022459:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1782727866.022528:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1782727866.022567:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1782727866.022783:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1782727866.022821:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1782727866.022849:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1782727866.022878:0:6602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004ef8791b pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571987712:0@lo:502: 00000100:00100000:1.0:1782727866.022928:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727866.023116:0:6602:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e495c0e7 going to sleep for 11 seconds 00000100:00100000:2.0:1782727866.023205:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571987712 00000100:00100000:2.0:1782727866.023212:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571987712 00000100:00100000:2.0:1782727866.023243:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782727866.023248:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000642fff2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+10:6602:x1869325571987712:12345-0@lo:502: 00000100:00100000:2.0:1782727866.023563:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000642fff2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+10:6602:x1869325571987712:12345-0@lo:502: Request processed in 313us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727866.023571:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782727866.023983:0:6602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004ef8791b pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571987712:0@lo:502: 00000040:00080000:1.0:1782727866.024111:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1782727866.024123:0:6602:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1782727866.024963:0:6621:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782727866.024975:0:6621:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1782727866.024984:0:6621:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727866.024987:0:6621:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1782727866.024993:0:6621:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782727866.025011:0:6621:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (0000000053308282) 00000020:00000080:0.0:1782727866.025036:0:6621:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1782727866.025042:0:6621:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1782727866.025120:0:6621:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000073332987 from lustre-OST0000, refs=2 00080000:01000000:0.0:1782727866.025128:0:6621:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1782727866.025137:0:6621:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x22171c6c29614be7 00010000:00010000:1.0:1782727866.029901:0:6621:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1782727866.030294:0:6621:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1782727866.032435:0:6621:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1782727866.032879:0:6621:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1782727866.040282:0:6621:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1782727866.041194:0:6621:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1782727866.042995:0:6621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1782727866.043011:0:6621:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782727866.043024:0:6621:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727866.043026:0:6621:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1782727866.043030:0:6621:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782727866.043034:0:6621:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727866.043036:0:6621:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782727866.043039:0:6621:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782727866.043040:0:6621:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1782727866.043104:0:6621:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782727866.043106:0:6621:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727866.043108:0:6621:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1782727866.043110:0:6621:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1782727866.043281:0:6602:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1782727866.043318:0:6602:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1782727866.043344:0:6602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: 000000001732336f/0x22171c6c29614bd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614bd9 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727866.043358:0:6602:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: 000000001732336f/0x22171c6c29614bd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614bd9 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727866.043366:0:6602:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8d56c75cf800 from 1 10000000:01000000:1.0:1782727866.043370:0:6602:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782727866.043422:0:6602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: 00000000bea37f17/0x22171c6c29614bee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727866.043431:0:6602:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: 00000000bea37f17/0x22171c6c29614bee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727866.043442:0:6602:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: 00000000bea37f17/0x22171c6c29614bee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727866.043471:0:6602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004ef8791b pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571987840:0@lo:101: 00000100:00100000:1.0:1782727866.043590:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727866.043653:0:6602:0:(client.c:2701:ptlrpc_set_wait()) set 000000001d4cde60 going to sleep for 11 seconds 00000100:00100000:2.0:1782727866.044928:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571987840 00000100:00100000:2.0:1782727866.044940:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571987840 00000100:00100000:2.0:1782727866.045005:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782727866.045014:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000572c0641 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+10:6602:x1869325571987840:12345-0@lo:101: 00010000:00010000:2.0:1782727866.045031:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727866.045049:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000364f00c7/0x22171c6c29614bf5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614bee expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727866.045078:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000364f00c7/0x22171c6c29614bf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614bee expref: 11 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727866.045088:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000364f00c7/0x22171c6c29614bf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614bee expref: 11 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727866.045097:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000364f00c7, rc 0) 00000100:00100000:2.0:1782727866.045169:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000572c0641 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:6602:x1869325571987840:12345-0@lo:101: Request processed in 156us (1581us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727866.045177:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782727866.045275:0:6602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004ef8791b pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571987840:0@lo:101: 00010000:00010000:1.0:1782727866.045299:0:6602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: 00000000bea37f17/0x22171c6c29614bee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614bf5 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727866.045319:0:6602:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: 00000000bea37f17/0x22171c6c29614bee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614bf5 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727866.045454:0:6602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004ef8791b pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571987968:0@lo:501: 00000100:00100000:1.0:1782727866.045487:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727866.045554:0:6602:0:(client.c:2701:ptlrpc_set_wait()) set 000000001d4cde60 going to sleep for 11 seconds 00000100:00100000:2.0:1782727866.046787:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571987968 00000100:00100000:2.0:1782727866.046796:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571987968 00000100:00100000:2.0:1782727866.046846:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782727866.046852:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057c96c28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:6602:x1869325571987968:12345-0@lo:501: 00000100:00100000:2.0:1782727866.047170:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057c96c28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:6602:x1869325571987968:12345-0@lo:501: Request processed in 317us (1683us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727866.047179:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782727866.047435:0:6602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004ef8791b pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571987968:0@lo:501: 00000100:00100000:1.0:1782727866.047483:0:6602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004ef8791b pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571988096:0@lo:503: 00000100:00100000:1.0:1782727866.047562:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727866.047610:0:6602:0:(client.c:2701:ptlrpc_set_wait()) set 000000001d4cde60 going to sleep for 11 seconds 00000100:00100000:2.0:1782727866.048534:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571988096 00000100:00100000:2.0:1782727866.048543:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571988096 00000100:00100000:2.0:1782727866.048590:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782727866.048597:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ede8984e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:6602:x1869325571988096:12345-0@lo:503: 00000100:00100000:2.0:1782727866.049148:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ede8984e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:6602:x1869325571988096:12345-0@lo:503: Request processed in 549us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727866.049156:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782727866.049808:0:6602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004ef8791b pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571988096:0@lo:503: 00000040:00080000:1.0:1782727866.050161:0:6602:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782727866.050256:0:6602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004ef8791b pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571988224:0@lo:502: 00000100:00100000:1.0:1782727866.050325:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727866.050368:0:6602:0:(client.c:2701:ptlrpc_set_wait()) set 000000001d4cde60 going to sleep for 11 seconds 00000100:00100000:2.0:1782727866.050819:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571988224 00000100:00100000:2.0:1782727866.050827:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571988224 00000100:00100000:2.0:1782727866.050864:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782727866.050871:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005595c04c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:6602:x1869325571988224:12345-0@lo:502: 00000100:00100000:2.0:1782727866.051097:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005595c04c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:6602:x1869325571988224:12345-0@lo:502: Request processed in 227us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727866.051105:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782727866.051821:0:6602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004ef8791b pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571988224:0@lo:502: 00000040:00080000:1.0:1782727866.052113:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1782727866.052176:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1782727866.052209:0:6602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004ef8791b pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571988352:0@lo:502: 00000100:00100000:1.0:1782727866.052267:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727866.052356:0:6602:0:(client.c:2701:ptlrpc_set_wait()) set 000000001d4cde60 going to sleep for 11 seconds 00000100:00100000:3.0:1782727866.056538:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571988352 00000100:00100000:3.0:1782727866.056555:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571988352 00000100:00100000:3.0:1782727866.056628:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782727866.056637:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078e44827 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:6602:x1869325571988352:12345-0@lo:502: 00000100:00100000:3.0:1782727866.057038:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078e44827 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:6602:x1869325571988352:12345-0@lo:502: Request processed in 401us (4771us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727866.057048:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782727866.057257:0:6602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004ef8791b pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571988352:0@lo:502: 00000040:00080000:1.0:1782727866.057473:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1782727866.057494:0:6602:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1782727866.058249:0:6625:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782727866.058261:0:6625:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727866.058264:0:6625:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782727866.058271:0:6625:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d56c75cf800 00000020:00000080:1.0:1782727866.058273:0:6625:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782727866.058326:0:6625:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727866.058330:0:6625:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727866.058331:0:6625:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1782727866.058335:0:6625:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1782727866.059180:0:6602:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1782727866.059209:0:6602:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782727866.059263:0:6602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9800/0x22171c6c29614bee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614bf5 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727866.059278:0:6602:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9800/0x22171c6c29614bee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614bf5 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727866.059333:0:6602:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782727866.059349:0:6602:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d56c75cf800 10000000:01000000:2.0:1782727866.059352:0:6602:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d56c75cf800 10000000:01000000:2.0:1782727866.059357:0:6602:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782727866.059364:0:6602:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8d56c75cf800 from 1 10000000:01000000:2.0:1782727866.059367:0:6602:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782727866.059422:0:6602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614bfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727866.059432:0:6602:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614bfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727866.059445:0:6602:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614bfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727866.059471:0:6602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571988480:0@lo:101: 00000100:00100000:2.0:1782727866.059572:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727866.059831:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571988480 00000100:00100000:3.0:1782727866.059840:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571988480 00000100:00100000:3.0:1782727866.059905:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782727866.059915:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0875c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:6602:x1869325571988480:12345-0@lo:101: 00010000:00010000:3.0:1782727866.059928:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727866.059942:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56c1666e00/0x22171c6c29614c03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614bfc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727866.059968:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56c1666e00/0x22171c6c29614c03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614bfc expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727866.059978:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56c1666e00/0x22171c6c29614c03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614bfc expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727866.059987:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56c1666e00, rc 0) 00000100:00100000:3.0:1782727866.060025:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0875c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:6602:x1869325571988480:12345-0@lo:101: Request processed in 113us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727866.060032:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782727866.060130:0:6602:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56dcd62b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782727866.060155:0:6602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571988480:0@lo:101: 00010000:00010000:2.0:1782727866.060170:0:6602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614bfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614c03 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727866.060179:0:6602:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614bfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614c03 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727866.060275:0:6602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571988608:0@lo:501: 00000100:00100000:2.0:1782727866.060298:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727866.060326:0:6602:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56dcd62b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782727866.060428:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571988608 00000100:00100000:3.0:1782727866.060432:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571988608 00000100:00100000:3.0:1782727866.060460:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782727866.060466:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0876050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:6602:x1869325571988608:12345-0@lo:501: 00000100:00100000:3.0:1782727866.060913:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0876050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:6602:x1869325571988608:12345-0@lo:501: Request processed in 445us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727866.060920:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782727866.060987:0:6602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571988608:0@lo:501: 00000100:00100000:1.0:1782727866.061020:0:6602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571988736:0@lo:503: 00000100:00100000:1.0:1782727866.061061:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727866.061087:0:6602:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d9f05c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782727866.061146:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571988736 00000100:00100000:2.0:1782727866.061150:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571988736 00000100:00100000:2.0:1782727866.061180:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782727866.061193:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:6602:x1869325571988736:12345-0@lo:503: 00000100:00100000:2.0:1782727866.061355:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:6602:x1869325571988736:12345-0@lo:503: Request processed in 162us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727866.061362:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782727866.061440:0:6602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571988736:0@lo:503: 00000040:00080000:1.0:1782727866.061824:0:6602:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782727866.061891:0:6602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571988864:0@lo:502: 00000100:00100000:1.0:1782727866.061924:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727866.061944:0:6602:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d9f05c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782727866.062173:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571988864 00000100:00100000:2.0:1782727866.062178:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571988864 00000100:00100000:2.0:1782727866.062211:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782727866.062217:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:6602:x1869325571988864:12345-0@lo:502: 00000100:00100000:2.0:1782727866.062390:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:6602:x1869325571988864:12345-0@lo:502: Request processed in 163us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727866.062397:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782727866.062728:0:6602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571988864:0@lo:502: 00000040:00080000:1.0:1782727866.062998:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1782727866.063057:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1782727866.063090:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1782727866.063132:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1782727866.063191:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1782727866.063235:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1782727866.063264:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1782727866.063302:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1782727866.064446:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1782727866.064503:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1782727866.064549:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1782727866.064934:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1782727866.064982:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1782727866.065016:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1782727866.065062:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1782727866.065098:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1782727866.065129:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1782727866.065172:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1782727866.065206:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1782727866.065238:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1782727866.065305:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1782727866.065484:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1782727866.067592:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1782727866.067847:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1782727866.067877:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1782727866.067904:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1782727866.067942:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1782727866.067970:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1782727866.068027:0:6602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571988992:0@lo:502: 00000100:00100000:1.0:1782727866.068130:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727866.068194:0:6602:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d9f05c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782727866.068349:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571988992 00000100:00100000:2.0:1782727866.068358:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571988992 00000100:00100000:2.0:1782727866.068430:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782727866.068440:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0874c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:6602:x1869325571988992:12345-0@lo:502: 00000100:00100000:2.0:1782727866.069044:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0874c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:6602:x1869325571988992:12345-0@lo:502: Request processed in 604us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727866.069054:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1782727866.069602:0:6602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571988992:0@lo:502: 00000040:00080000:0.0:1782727866.069880:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1782727866.069899:0:6602:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1782727866.071026:0:6626:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1782727866.071062:0:6626:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d56ffb219d0) 00000020:00000080:3.0:1782727866.071091:0:6626:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1782727866.071555:0:6626:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d56c75cf800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1782727866.071560:0:6626:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d56c75cf800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1782727866.071563:0:6626:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8d56c75cf800 3 00010000:00080000:3.0:1782727866.071614:0:6626:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d56ffb74000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.131@tcp at head 00010000:00010000:3.0:1782727866.074488:0:6626:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1782727866.075466:0:6626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1782727866.075757:0:6626:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782727866.075771:0:6626:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x22171c6c29614c11 00000100:00080000:3.0:1782727866.075785:0:6626:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782727866.075793:0:6626:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d56ffb74000 using connection 192.168.202.131@tcp/0@lo 00000100:00100000:3.0:1782727866.075838:0:6626:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d56f55e3800 x1869325571989120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782727866.075908:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1869325571989120:0@lo:38: 00000100:00100000:2.0:1782727866.076003:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782727866.076073:0:6626:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1782727866.076143:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869325571989248:0@lo:400: 00000100:00100000:3.0:1782727866.076174:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727866.077485:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571989120 00000100:00100000:3.0:1782727866.077498:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571989120 00000100:00100000:3.0:1782727866.077560:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571989248 00000100:00100000:3.0:1782727866.077564:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571989248 00000100:00100000:3.0:1782727866.077598:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782727866.077623:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869325571989248:12345-0@lo:400: 00000100:00100000:3.0:1782727866.077869:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f55e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869325571989248:12345-0@lo:400: Request processed in 248us (1692us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727866.077878:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782727866.077897:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782727866.077902:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1869325571989120:12345-0@lo:38: 00010000:00080000:3.0:1782727866.077926:0:5808:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:3.0:1782727866.077972:0:5808:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x22171c6c29614c18 00000004:00100000:3.0:1782727866.077990:0:5808:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1782727866.078031:0:5808:0:(import.c:65:import_set_state_nolock()) ffff8d56ffb76800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782727866.079233:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869325571989120:12345-0@lo:38: Request processed in 1323us (3224us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727866.079245:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1782727866.079299:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d56f55e1f80 x1869325571989248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727866.079327:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869325571989248:0@lo:400: 00000040:00080000:3.0:1782727866.080103:0:6626:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1782727866.080432:0:6602:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1782727866.080466:0:6602:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782727866.080490:0:6602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614bfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614c03 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727866.080502:0:6602:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614bfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614c03 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1782727866.080591:0:6602:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1782727866.080593:0:6602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782727866.080595:0:6602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727866.080597:0:6602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782727866.080598:0:6602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727866.080600:0:6602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727866.080602:0:6602:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782727866.080612:0:6602:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782727866.080614:0:6602:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782727866.080616:0:6602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727866.080618:0:6602:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782727866.080623:0:6602:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1782727866.080625:0:6602:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782727866.080627:0:6602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782727866.080628:0:6602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727866.080630:0:6602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782727866.080631:0:6602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727866.080632:0:6602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727866.080633:0:6602:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782727866.080634:0:6602:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782727866.080635:0:6602:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782727866.080636:0:6602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727866.080637:0:6602:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782727866.080664:0:6602:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1782727866.080795:0:6602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571989376:0@lo:253: 00000100:00100000:1.0:1782727866.080870:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727866.080910:0:6602:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d9f05b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782727866.080978:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571989376 00000100:00100000:3.0:1782727866.080985:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571989376 00000100:00100000:3.0:1782727866.081059:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782727866.081069:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0874850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:6602:x1869325571989376:12345-0@lo:253: 20000000:01000000:3.0:1782727866.081095:0:5798:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1782727866.081111:0:5798:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1782727866.081941:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d56f55e3800 x1869325571989120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782727876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727866.081956:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782727866.081965:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1782727866.081973:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1782727866.081980:0:3313:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1782727866.081993:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8d56ffb74000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1782727866.082001:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1869325571989120:0@lo:38: 20000000:01000000:1.0:1782727866.112776:0:5798:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782727866.112801:0:5798:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1782727866.112908:0:5823:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1782727866.112915:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782727866.112943:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d56c0030a00/0x22171c6c29614c1f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727866.112966:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d56c1667600/0x22171c6c29614b8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614b85 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727866.112977:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d56c0030a00/0x22171c6c29614c1f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727866.113026:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d56c1667600/0x22171c6c29614b8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22171c6c29614b85 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727866.113043:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d56c1667600/0x22171c6c29614b8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22171c6c29614b85 expref: 12 pid: 5801 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727866.113086:0:5823:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1869325571989504:0@lo:104: 00000100:00100000:0.0:1782727866.113174:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727866.113243:0:5823:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c7580240 going to sleep for 11 seconds 00000100:00100000:2.0:1782727866.113319:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571989504 00000100:00100000:2.0:1782727866.113327:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571989504 00000100:00100000:2.0:1782727866.113394:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782727866.113405:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+3:5823:x1869325571989504:12345-0@lo:104: 00010000:00010000:2.0:1782727866.113420:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8d56dd3ce800/0x22171c6c29614b85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614b8c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727866.113479:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782727866.113485:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+3:5823:x1869325571989504:12345-0@lo:104: Request processed in 82us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727866.113492:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1782727866.113553:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782727866.113558:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8d56dd3ce800/0x22171c6c29614b85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614b8c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727866.113565:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3ce800 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:2.0:1782727866.113570:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8d56dd3ce800/0x22171c6c29614b85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x22171c6c29614b8c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727866.113578:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8d56dd3ce800/0x22171c6c29614b85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x22171c6c29614b8c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782727866.113585:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8d56dd3ce800/0x22171c6c29614b85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x22171c6c29614b8c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727866.113591:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782727866.113621:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8d56dd3ce800/0x22171c6c29614b85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614b8c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727866.113635:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782727866.113658:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8d56dd3ce800/0x22171c6c29614b85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614b8c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727866.113665:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8d56dd3ce800/0x22171c6c29614b85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614b8c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727866.113867:0:5823:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1869325571989504:0@lo:104: 00010000:00010000:0.0:1782727866.113890:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d56c0030a00/0x22171c6c29614c1f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727866.113944:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727866.113946:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727866.113947:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727866.113973:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3315:1869325571989632:0@lo:103: 00000100:00100000:2.0:1782727866.114010:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727866.114104:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571989632 00000100:00100000:0.0:1782727866.114109:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571989632 00010000:00010000:0.0:1782727866.114128:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d56c1667600/0x22171c6c29614b8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614b85 expref: 13 pid: 5801 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727866.114158:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782727866.114166:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0eb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:3315:x1869325571989632:12345-0@lo:103: 00010000:00010000:0.0:1782727866.114177:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727866.114182:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d56c1667600/0x22171c6c29614b8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614b85 expref: 13 pid: 5801 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727866.114192:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d56c1667600/0x22171c6c29614b8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22171c6c29614b85 expref: 13 pid: 5801 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727866.114204:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56c1667600/0x22171c6c29614b8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22171c6c29614b85 expref: 13 pid: 5801 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727866.114218:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d56c0030a00/0x22171c6c29614c1f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727866.114226:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56c0030a00/0x22171c6c29614c1f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782727866.114246:0:5791:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002897499s 00010000:00010000:0.0:1782727866.114251:0:5791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d56c0030a00/0x22171c6c29614c1f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727866.114258:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d56c0030a00/0x22171c6c29614c1f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727866.114264:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d56c0030a00/0x22171c6c29614c1f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727866.114269:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d56c0030a00/0x22171c6c29614c1f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727866.114274:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56c0030a00 already unused, calling callback (ffffffffc152fcf0) 00010000:00010000:0.0:1782727866.114278:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d56c0030a00/0x22171c6c29614c1f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727866.114285:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d56c0030a00/0x22171c6c29614c1f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727866.114298:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d56c0030a00/0x22171c6c29614c1f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727866.114370:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727866.114413:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0eb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:3315:x1869325571989632:12345-0@lo:103: Request processed in 248us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727866.114421:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782727866.114478:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3315:1869325571989632:0@lo:103: 00010000:00010000:0.0:1782727866.114495:0:5823:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d56c0030a00/0x22171c6c29614c1f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727866.114535:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d56c0030a00/0x22171c6c29614c1f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727866.114544:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56c0030a00/0x22171c6c29614c1f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727866.122041:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0874850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:6602:x1869325571989376:12345-0@lo:253: Request processed in 40959us (41156us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727866.122058:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782727866.122253:0:6602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6602:1869325571989376:0@lo:253: 10000000:01000000:0.0:1782727866.122272:0:6602:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1782727866.122276:0:6602:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782727866.122278:0:6602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782727866.122279:0:6602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782727866.122280:0:6602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782727866.122282:0:6602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782727866.122284:0:6602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782727866.122286:0:6602:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782727866.122287:0:6602:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782727866.122289:0:6602:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782727866.122291:0:6602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782727866.122292:0:6602:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1782727866.122374:0:6602:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1782727866.127977:0:6602:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1782727866.128170:0:6602:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1782727866.128475:0:6602:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1782727866.128814:0:6602:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1782727866.129042:0:6602:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1782727866.129391:0:6602:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1782727866.135455:0:6602:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1782727866.351839:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1782727866.452292:0:6602:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1782727866.452375:0:6602:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1782727866.452430:0:6602:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782727866.452505:0:6602:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.131@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782727866.452568:0:6602:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1782727866.452601:0:6602:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1782727867.373623:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782727867.570344:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782727867.570353:0:5803:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8d56c8fb6000 from 21 10000000:01000000:0.0:1782727867.570359:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782727867.570427:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56c0030000/0x22171c6c29614c26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727867.570440:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d56c0030000/0x22171c6c29614c26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727867.570451:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d56c0030000/0x22171c6c29614c26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727867.570492:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571989760:0@lo:101: 00000100:00100000:0.0:1782727867.570592:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727867.570652:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c7580c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782727867.575636:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571989760 00000100:00100000:3.0:1782727867.575650:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571989760 00000100:00100000:3.0:1782727867.575708:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782727867.575718:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:5803:x1869325571989760:12345-0@lo:101: 00010000:00010000:3.0:1782727867.575737:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727867.575757:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56c1667000/0x22171c6c29614c2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614c26 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727867.575789:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56c1667000/0x22171c6c29614c2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614c26 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727867.575801:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56c1667000/0x22171c6c29614c2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614c26 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727867.575812:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56c1667000, rc 0) 00000100:00100000:3.0:1782727867.575897:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:5803:x1869325571989760:12345-0@lo:101: Request processed in 180us (5304us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727867.575904:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782727867.575968:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571989760:0@lo:101: 00010000:00010000:3.0:1782727867.575988:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d56c0030000/0x22171c6c29614c26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614c2d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727867.575998:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d56c0030000/0x22171c6c29614c26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614c2d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727867.576081:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571989888:0@lo:501: 00000100:00100000:3.0:1782727867.576115:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727867.576135:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d0e6f780 going to sleep for 11 seconds 00000100:00100000:3.0:1782727867.576150:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571989888 00000100:00100000:3.0:1782727867.576154:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571989888 00000100:00100000:3.0:1782727867.576174:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782727867.576181:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0874050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:5803:x1869325571989888:12345-0@lo:501: 00000100:00100000:3.0:1782727867.576459:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0874050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:5803:x1869325571989888:12345-0@lo:501: Request processed in 278us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727867.576466:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782727867.576496:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571989888:0@lo:501: 00000100:00100000:3.0:1782727867.576548:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571990016:0@lo:503: 00000100:00100000:3.0:1782727867.576580:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727867.576592:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d0e6f780 going to sleep for 11 seconds 00000100:00100000:3.0:1782727867.576603:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571990016 00000100:00100000:3.0:1782727867.576606:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571990016 00000100:00100000:3.0:1782727867.576627:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782727867.576641:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0874450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:5803:x1869325571990016:12345-0@lo:503: 00000100:00100000:3.0:1782727867.576790:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0874450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:5803:x1869325571990016:12345-0@lo:503: Request processed in 149us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727867.576797:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782727867.576831:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571990016:0@lo:503: 00000100:00100000:3.0:1782727867.576994:0:6687:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6687:1869325571990144:0@lo:502: 00000100:00100000:3.0:1782727867.577025:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727867.577043:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571990144 00000100:00100000:3.0:1782727867.577046:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571990144 00000100:00100000:3.0:1782727867.577067:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782727867.577074:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:6687:x1869325571990144:12345-0@lo:502: 00000100:00100000:3.0:1782727867.577222:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:6687:x1869325571990144:12345-0@lo:502: Request processed in 148us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727867.577229:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782727867.577256:0:6687:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d0e6f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727867.577268:0:6687:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6687:1869325571990144:0@lo:502: 00000100:00100000:3.0:1782727867.577308:0:6687:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6687:1869325571990272:0@lo:502: 00000100:00100000:3.0:1782727867.577334:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727867.577350:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571990272 00000100:00100000:3.0:1782727867.577353:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571990272 00000100:00100000:3.0:1782727867.577384:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782727867.577390:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0875850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:6687:x1869325571990272:12345-0@lo:502: 00000100:00100000:3.0:1782727867.577496:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0875850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:6687:x1869325571990272:12345-0@lo:502: Request processed in 105us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727867.577503:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782727867.577558:0:6687:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d0e6f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727867.577570:0:6687:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6687:1869325571990272:0@lo:502: 00000040:00080000:3.0:1782727867.577588:0:6687:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1782727867.577639:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1782727867.577656:0:5803:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782727867.577665:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56c0030000/0x22171c6c29614c26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614c2d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727867.577676:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d56c0030000/0x22171c6c29614c26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614c2d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727867.577685:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782727867.577688:0:5803:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8d56c8fb6000 from 4 10000000:01000000:3.0:1782727867.577690:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782727867.577717:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56c1667400/0x22171c6c29614c34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727867.577725:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d56c1667400/0x22171c6c29614c34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727867.577734:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d56c1667400/0x22171c6c29614c34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727867.577745:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571990400:0@lo:101: 00000100:00100000:3.0:1782727867.577769:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727867.577782:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d0e6f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727867.577793:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571990400 00000100:00100000:3.0:1782727867.577796:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571990400 00000100:00100000:3.0:1782727867.577815:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782727867.577821:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0875450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:5803:x1869325571990400:12345-0@lo:101: 00010000:00010000:3.0:1782727867.577837:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727867.577850:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56c1667600/0x22171c6c29614c3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614c34 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727867.577871:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56c1667600/0x22171c6c29614c3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614c34 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727867.577880:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56c1667600/0x22171c6c29614c3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614c34 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727867.577888:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56c1667600, rc 0) 00000100:00100000:3.0:1782727867.577916:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0875450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:5803:x1869325571990400:12345-0@lo:101: Request processed in 95us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727867.577922:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782727867.577949:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571990400:0@lo:101: 00010000:00010000:3.0:1782727867.577960:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d56c1667400/0x22171c6c29614c34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614c3b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727867.577967:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d56c1667400/0x22171c6c29614c34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614c3b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727867.578009:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571990528:0@lo:256: 00000100:00100000:3.0:1782727867.578038:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727867.578050:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d0e6f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727867.578061:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571990528 00000100:00100000:3.0:1782727867.578064:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571990528 00000100:00100000:3.0:1782727867.578084:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782727867.578089:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:5803:x1869325571990528:12345-0@lo:256: 20000000:01000000:3.0:1782727867.578110:0:5800:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1782727867.578126:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1782727867.578129:0:5800:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1782727867.578205:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:5803:x1869325571990528:12345-0@lo:256: Request processed in 114us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727867.578212:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782727867.578239:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571990528:0@lo:256: 10000000:01000000:3.0:1782727867.578274:0:5803:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782727867.578280:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56c1667400/0x22171c6c29614c34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614c3b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727867.578287:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d56c1667400/0x22171c6c29614c34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614c3b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727867.578294:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1782727867.578296:0:5803:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1782727867.578299:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782727867.578315:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56c1666600/0x22171c6c29614c42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727867.578321:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d56c1666600/0x22171c6c29614c42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727867.578328:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d56c1666600/0x22171c6c29614c42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727867.578339:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571990656:0@lo:101: 00000100:00100000:3.0:1782727867.578362:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727867.578390:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d0e6f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727867.578407:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571990656 00000100:00100000:3.0:1782727867.578410:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571990656 00000100:00100000:3.0:1782727867.578430:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782727867.578435:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0876450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:5803:x1869325571990656:12345-0@lo:101: 00010000:00010000:3.0:1782727867.578441:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727867.578449:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56c1667e00/0x22171c6c29614c49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614c42 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727867.578463:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56c1667e00/0x22171c6c29614c49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614c42 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727867.578470:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56c1667e00/0x22171c6c29614c49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614c42 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727867.578476:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56c1667e00, rc 0) 00000100:00100000:3.0:1782727867.578502:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0876450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:5803:x1869325571990656:12345-0@lo:101: Request processed in 68us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727867.578530:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782727867.578578:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571990656:0@lo:101: 00010000:00010000:3.0:1782727867.578589:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d56c1666600/0x22171c6c29614c42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614c49 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727867.578596:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d56c1666600/0x22171c6c29614c42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614c49 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727867.578636:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571990784:0@lo:501: 00000100:00100000:3.0:1782727867.578661:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727867.578673:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d0e6f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727867.578684:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571990784 00000100:00100000:3.0:1782727867.578692:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571990784 00000100:00100000:3.0:1782727867.578712:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782727867.578718:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0875050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:5803:x1869325571990784:12345-0@lo:501: 00000100:00100000:3.0:1782727867.578941:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0875050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:5803:x1869325571990784:12345-0@lo:501: Request processed in 222us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727867.578948:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782727867.578977:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571990784:0@lo:501: 00000100:00100000:3.0:1782727867.579000:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571990912:0@lo:503: 00000100:00100000:3.0:1782727867.579032:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727867.579045:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d0e6f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727867.579055:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571990912 00000100:00100000:3.0:1782727867.579058:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571990912 00000100:00100000:3.0:1782727867.579078:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782727867.579083:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:5803:x1869325571990912:12345-0@lo:503: 00000100:00100000:3.0:1782727867.579264:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:5803:x1869325571990912:12345-0@lo:503: Request processed in 180us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727867.579270:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782727867.579302:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571990912:0@lo:503: 00000100:00100000:3.0:1782727867.593345:0:6688:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6688:1869325571991040:0@lo:502: 00000100:00100000:3.0:1782727867.593446:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727867.593487:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571991040 00000100:00100000:3.0:1782727867.593494:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571991040 00000100:00100000:3.0:1782727867.593562:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782727867.593571:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:6688:x1869325571991040:12345-0@lo:502: 00000100:00100000:3.0:1782727867.593873:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:6688:x1869325571991040:12345-0@lo:502: Request processed in 302us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727867.593889:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782727867.593946:0:6688:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d0e6fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1782727867.593966:0:6688:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6688:1869325571991040:0@lo:502: 00000020:01000000:3.0:1782727867.593992:0:6688:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782727867.594000:0:6688:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1782727867.594006:0:6688:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727867.594008:0:6688:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1782727867.594013:0:6688:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1782727867.594017:0:6688:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.131@tcp to nid 0x20000c0a8ca83 (192.168.202.131@tcp) 00000020:01000000:3.0:1782727867.594039:0:6688:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1782727867.594041:0:6688:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782727867.594056:0:6688:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d56ffb20000) 00000020:00000080:3.0:1782727867.594075:0:6688:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1782727867.594079:0:6688:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1782727867.594162:0:6688:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1782727867.594168:0:6688:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1782727867.594175:0:6688:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22171c6c29614c57 00010000:00080000:3.0:1782727867.594204:0:6688:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d56ff878800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.131@tcp at head 00010000:00010000:3.0:1782727867.594448:0:6688:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1782727867.722667:0:6688:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1782727867.722695:0:6688:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1782727867.723506:0:6688:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782727867.723777:0:6688:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782727867.723818:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1782727867.723923:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1782727867.739437:0:6699:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782727867.739446:0:6699:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1782727867.749084:0:6688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782727867.749106:0:6688:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1782727867.749157:0:6688:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1782727867.749183:0:6688:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22171c6c29614c5e 00000100:00080000:1.0:1782727867.749197:0:6688:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782727867.749204:0:6688:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d56ff878800 using connection 192.168.202.131@tcp/0@lo 00000100:00100000:1.0:1782727867.749248:0:6688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d56f59e4700 x1869325571991168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782727867.749330:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869325571991168:0@lo:8: 00000100:00100000:2.0:1782727867.749449:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782727867.750042:0:6688:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1782727867.750141:0:6688:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727867.750148:0:6688:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727867.750152:0:6688:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1782727867.750156:0:6688:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782727867.750161:0:6688:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727867.750163:0:6688:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782727867.750166:0:6688:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782727867.750168:0:6688:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1782727867.750205:0:6688:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6688:1869325571991296:0@lo:502: 00000100:00100000:1.0:1782727867.750266:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727867.750295:0:6688:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c68b3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727867.750454:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571991168 00000100:00100000:3.0:1782727867.750462:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571991168 00000100:00100000:3.0:1782727867.750502:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782727867.750530:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1869325571991168:12345-0@lo:8: 00010000:00080000:3.0:1782727867.750559:0:6604:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:3.0:1782727867.750591:0:6604:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22171c6c29614c65 00002000:00100000:3.0:1782727867.750631:0:6604:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d56ff879800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1782727867.750636:0:6604:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1782727867.750645:0:6604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1782727867.750822:0:6604:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1782727867.751141:0:6604:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782727867.751178:0:6604:0:(import.c:65:import_set_state_nolock()) ffff8d56ff87a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782727867.751594:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571991296 00000100:00100000:1.0:1782727867.751601:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571991296 00000100:00100000:1.0:1782727867.751641:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782727867.751649:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:6688:x1869325571991296:12345-0@lo:502: 00000100:00100000:1.0:1782727867.751952:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:6688:x1869325571991296:12345-0@lo:502: Request processed in 301us (1683us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727867.751960:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782727867.751990:0:6688:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6688:1869325571991296:0@lo:502: 00000100:00100000:1.0:1782727867.752015:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869325571991424:0@lo:400: 00000100:00100000:1.0:1782727867.752058:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727867.752088:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727867.752094:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869325571991552:0@lo:400: 00000100:00100000:1.0:1782727867.752119:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727867.752157:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571991424 00000100:00100000:1.0:1782727867.752161:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571991424 00000100:00100000:1.0:1782727867.752187:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571991552 00000100:00100000:1.0:1782727867.752190:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571991552 00000100:00100000:1.0:1782727867.752215:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782727867.752222:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869325571991424:12345-0@lo:400: 00000100:00100000:1.0:1782727867.752261:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869325571991424:12345-0@lo:400: Request processed in 39us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727867.752268:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782727867.752279:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782727867.752285:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869325571991552:12345-0@lo:400: 00000100:00100000:1.0:1782727867.752309:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869325571991552:12345-0@lo:400: Request processed in 25us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727867.752444:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1782727867.752479:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782727867.752505:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d56f59e4380 x1869325571991552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727867.752539:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869325571991552:0@lo:400: 00010000:00080000:1.0:1782727867.752553:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d56f59e7800 x1869325571991424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727867.752562:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869325571991424:0@lo:400: 00000100:00100000:3.0:1782727867.752771:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1869325571991168:12345-0@lo:8: Request processed in 2241us (3323us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727867.752782:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1782727867.752862:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d56f59e4700 x1869325571991168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782727877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727867.752873:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782727867.752881:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1782727867.752896:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1782727867.752903:0:3313:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1782727867.752906:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8d56ff878800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1782727867.752965:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1782727867.752973:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869325571991168:0@lo:8: 00000004:00080000:3.0:1782727867.753560:0:6699:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1782727867.753749:0:6699:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 191707238917ns, next at 0ns, rc = 0 00000020:01000000:0.0:1782727867.755927:0:6688:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727867.755939:0:6688:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727867.755943:0:6688:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782727867.755950:0:6688:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1782727867.756771:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1782727867.756799:0:5803:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782727867.756813:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56c1666600/0x22171c6c29614c42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614c49 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727867.756828:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d56c1666600/0x22171c6c29614c42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614c49 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727867.756839:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782727867.756842:0:5803:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8d56c8fb6000 from 1 10000000:01000000:3.0:1782727867.756845:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782727867.756890:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56c1666a00/0x22171c6c29614c6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727867.756899:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d56c1666a00/0x22171c6c29614c6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727867.756912:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d56c1666a00/0x22171c6c29614c6c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727867.756941:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571991680:0@lo:101: 00000100:00100000:3.0:1782727867.757042:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727867.757092:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d0e6f840 going to sleep for 11 seconds 00000100:00100000:3.0:1782727867.757121:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571991680 00000100:00100000:3.0:1782727867.757129:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571991680 00000100:00100000:3.0:1782727867.757189:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782727867.757200:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:5803:x1869325571991680:12345-0@lo:101: 00010000:00010000:3.0:1782727867.757216:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727867.757231:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56c1666800/0x22171c6c29614c73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614c6c expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727867.757259:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56c1666800/0x22171c6c29614c73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614c6c expref: 15 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727867.757271:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56c1666800/0x22171c6c29614c73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614c6c expref: 15 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727867.757280:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56c1666800, rc 0) 00000100:00100000:3.0:1782727867.758462:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:5803:x1869325571991680:12345-0@lo:101: Request processed in 1256us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727867.758476:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782727867.758924:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571991680:0@lo:101: 00010000:00010000:3.0:1782727867.758951:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d56c1666a00/0x22171c6c29614c6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614c73 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727867.758963:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d56c1666a00/0x22171c6c29614c6c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614c73 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727867.761312:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571991808:0@lo:501: 00000100:00100000:3.0:1782727867.762446:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727867.762537:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d0e6f840 going to sleep for 11 seconds 00000100:00100000:3.0:1782727867.762578:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571991808 00000100:00100000:3.0:1782727867.762587:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571991808 00000100:00100000:3.0:1782727867.762639:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782727867.762649:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:5803:x1869325571991808:12345-0@lo:501: 00000100:00100000:3.0:1782727867.763985:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:5803:x1869325571991808:12345-0@lo:501: Request processed in 1326us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727867.764073:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782727867.767132:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571991808:0@lo:501: 00000100:00100000:0.0:1782727867.767779:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571991936:0@lo:503: 00000100:00100000:0.0:1782727867.767885:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727867.767937:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c75803c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727867.767967:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571991936 00000100:00100000:0.0:1782727867.767974:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571991936 00000100:00100000:0.0:1782727867.768156:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782727867.768169:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:5803:x1869325571991936:12345-0@lo:503: 00000100:00100000:0.0:1782727867.768459:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:5803:x1869325571991936:12345-0@lo:503: Request processed in 293us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727867.768469:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782727867.768583:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571991936:0@lo:503: 00000100:00100000:2.0:1782727867.771192:0:6703:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6703:1869325571992064:0@lo:502: 00000100:00100000:2.0:1782727867.772777:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727867.772862:0:6703:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56ffcc86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727867.773819:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571992064 00000100:00100000:0.0:1782727867.773832:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571992064 00000100:00100000:0.0:1782727867.773894:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782727867.773905:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:6703:x1869325571992064:12345-0@lo:502: 00000100:00100000:0.0:1782727867.774223:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:6703:x1869325571992064:12345-0@lo:502: Request processed in 318us (2908us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727867.774245:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782727867.775581:0:6703:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6703:1869325571992064:0@lo:502: 00000020:01000000:3.0:1782727867.775625:0:6703:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782727867.775637:0:6703:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727867.775640:0:6703:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1782727867.775648:0:6703:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d56c8fb6000 00000020:00000080:3.0:1782727867.775651:0:6703:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782727867.775706:0:6703:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6703:1869325571992192:0@lo:502: 00000100:00100000:3.0:1782727867.775769:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727867.775809:0:6703:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d0e6fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727867.775902:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571992192 00000100:00100000:1.0:1782727867.775910:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571992192 00000100:00100000:1.0:1782727867.775950:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782727867.775958:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:6703:x1869325571992192:12345-0@lo:502: 00000100:00100000:1.0:1782727867.776124:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:6703:x1869325571992192:12345-0@lo:502: Request processed in 165us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727867.776131:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782727867.776212:0:6703:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:6703:1869325571992192:0@lo:502: 00000020:01000000:3.0:1782727867.776231:0:6703:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782727867.776235:0:6703:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727867.776237:0:6703:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1782727867.776241:0:6703:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1782727867.776409:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1782727867.776435:0:5803:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782727867.776447:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56c1666a00/0x22171c6c29614c6c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614c73 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727867.776460:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d56c1666a00/0x22171c6c29614c6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614c73 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727867.776471:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1782727867.776475:0:5803:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8d56d0964d70 from 1 10000000:01000000:1.0:1782727867.776478:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1782727867.776527:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9e00/0x22171c6c29614c7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727867.776544:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9e00/0x22171c6c29614c7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727867.776554:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9e00/0x22171c6c29614c7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727867.776569:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571992320:0@lo:101: 00000100:00100000:1.0:1782727867.776602:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727867.776624:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d9f05600 going to sleep for 11 seconds 00000100:00100000:0.0:1782727867.779738:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571992320 00000100:00100000:0.0:1782727867.779755:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571992320 00000100:00100000:0.0:1782727867.779828:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782727867.780429:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:5803:x1869325571992320:12345-0@lo:101: 00010000:00010000:0.0:1782727867.780448:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727867.780467:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56c0031600/0x22171c6c29614c81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614c7a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727867.780495:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56c0031600/0x22171c6c29614c81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614c7a expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727867.780503:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56c0031600/0x22171c6c29614c81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614c7a expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727867.780526:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56c0031600, rc 0) 00000100:00100000:0.0:1782727867.780611:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:5803:x1869325571992320:12345-0@lo:101: Request processed in 772us (4008us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727867.780616:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782727867.780671:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571992320:0@lo:101: 00010000:00010000:0.0:1782727867.780687:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9e00/0x22171c6c29614c7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614c81 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727867.780728:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9e00/0x22171c6c29614c7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614c81 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727867.780796:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571992448:0@lo:501: 00000100:00100000:0.0:1782727867.781984:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727867.782033:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571992448 00000100:00100000:0.0:1782727867.782041:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571992448 00000100:00100000:0.0:1782727867.782095:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782727867.782107:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:5803:x1869325571992448:12345-0@lo:501: 00000100:00100000:0.0:1782727867.782332:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:5803:x1869325571992448:12345-0@lo:501: Request processed in 227us (351us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782727867.782339:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782727867.782818:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c7580480 going to sleep for 11 seconds 00000100:00100000:0.0:1782727867.782851:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325571992448:0@lo:501: 10000000:01000000:0.0:1782727867.782900:0:5803:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782727867.782911:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9e00/0x22171c6c29614c7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614c81 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727867.782920:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9e00/0x22171c6c29614c7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614c81 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782727867.822717:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1782727867.853925:0:6700:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1782727867.853971:0:6700:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09a9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6700:1869325571992704:0@lo:7: 00000100:00100000:2.0:1782727867.854060:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727867.854115:0:6700:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56ffcc8540 going to sleep for 11 seconds 00000100:00100000:2.0:1782727867.854150:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571992704 00000100:00100000:2.0:1782727867.854157:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571992704 00000100:00100000:2.0:1782727867.854232:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782727867.854241:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6700:x1869325571992704:12345-0@lo:7: 00000100:00080000:3.0:1782727867.854250:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727867.854468:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325571992576:0@lo:13: 00000100:00100000:0.0:1782727867.854554:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727867.854584:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571992576 00000100:00100000:3.0:1782727867.854588:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571992576 00000100:00100000:3.0:1782727867.854623:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782727867.854632:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1869325571992576:12345-0@lo:13: 00002000:00000024:3.0:1782727867.854671:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1782727867.854732:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1869325571992576:12345-0@lo:13: Request processed in 100us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727867.854742:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1782727867.854779:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d56d09aa680 x1869325571992576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727867.854805:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325571992576:0@lo:13: 00002000:00080000:1.0:1782727867.861918:0:6607:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1782727867.861930:0:6607:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1782727867.862251:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6700:x1869325571992704:12345-0@lo:7: Request processed in 8003us (8184us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727867.862265:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782727867.862491:0:6700:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d56d09a9880 x1869325571992704/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782727883 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727867.862544:0:6700:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09a9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6700:1869325571992704:0@lo:7: 00000004:00080000:2.0:1782727867.862564:0:6700:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1782727867.862612:0:6700:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09a9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6700:1869325571992832:0@lo:5: 00000100:00100000:2.0:1782727867.863401:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727867.863488:0:6700:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56ffcc8540 going to sleep for 11 seconds 00000100:00100000:3.0:1782727867.863722:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571992832 00000100:00100000:3.0:1782727867.863731:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571992832 00000100:00100000:3.0:1782727867.863799:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782727867.863811:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6700:x1869325571992832:12345-0@lo:5: 00002000:00080000:3.0:1782727867.863848:0:6606:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1782727867.863853:0:6606:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1782727867.864307:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6700:x1869325571992832:12345-0@lo:5: Request processed in 497us (1648us total) trans 4294967297 rc 0/0 00010000:00080000:2.0:1782727867.864980:0:6700:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d56d09a9880 x1869325571992832/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782727883 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727867.865002:0:6700:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09a9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6700:1869325571992832:0@lo:5: 00000004:00080000:2.0:1782727867.865019:0:6700:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1782727867.865069:0:6700:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09a8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6700:1869325571992960:0@lo:700: 00000100:00100000:2.0:1782727867.865114:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727867.865153:0:6700:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56ffcc8540 going to sleep for 11 seconds 00000100:00100000:1.0:1782727867.865156:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571992960 00000100:00100000:1.0:1782727867.865165:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571992960 00000100:00100000:1.0:1782727867.865277:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782727867.865287:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+8:6700:x1869325571992960:12345-0@lo:700: 00000100:00100000:1.0:1782727867.865325:0:6613:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6613:1869325571993088:0@lo:700: 00000100:00100000:1.0:1782727867.865359:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727867.865393:0:6613:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d8266240 going to sleep for 11 seconds 00000100:00100000:1.0:1782727867.865417:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571993088 00000100:00100000:1.0:1782727867.865421:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571993088 00000100:00100000:1.0:1782727867.865454:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782727867.865461:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6613:x1869325571993088:12345-0@lo:700: 00000100:00100000:3.0:1782727867.866488:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 40000000:02000000:1.0:1782727867.894343:0:5813:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1782727867.902140:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6613:x1869325571993088:12345-0@lo:700: Request processed in 36662us (36762us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727867.902161:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1782727867.902361:0:6613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d56f59e4380 x1869325571993088/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782727883 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727867.902391:0:6613:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6613:1869325571993088:0@lo:700: 40000000:02000000:2.0:1782727867.902408:0:6613:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1782727868.031071:0:6630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1782727868.031099:0:6630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1782727868.031251:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6700:x1869325571992960:12345-0@lo:700: Request processed in 165959us (166129us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727868.031265:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782727868.031618:0:6700:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d56d09a8e00 x1869325571992960/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782727883 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727868.031632:0:6700:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1782727868.031713:0:6700:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09a8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6700:1869325571992960:0@lo:700: 00000004:02000040:1.0:1782727868.115589:0:6700:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1782727868.124144:0:6700:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6700:1869325571993216:0@lo:5: 00000100:00100000:0.0:1782727868.125677:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727868.125743:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571993216 00000100:00100000:1.0:1782727868.125754:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571993216 00000100:00100000:0.0:1782727868.125761:0:6700:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c7580cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727868.125816:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782727868.125832:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6700:x1869325571993216:12345-0@lo:5: 00002000:00080000:2.0:1782727868.137101:0:6607:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1782727868.137124:0:6607:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1782727868.139989:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6700:x1869325571993216:12345-0@lo:5: Request processed in 14156us (14309us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1782727868.140000:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1782727868.140174:0:6700:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d56f5ae1180 x1869325571993216/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782727884 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727868.140192:0:6700:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6700:1869325571993216:0@lo:5: 00000004:00080000:0.0:1782727868.140208:0:6700:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1782727868.404022:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727869.425790:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727870.446623:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727871.469814:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782727872.325768:0:6975:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1782727872.496202:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727873.133765:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325571993344:0@lo:13: 00000100:00100000:2.0:1782727873.133850:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727873.134001:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571993344 00000100:00100000:2.0:1782727873.134010:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571993344 00000100:00100000:2.0:1782727873.134083:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782727873.134092:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869325571993344:12345-0@lo:13: 00002000:00000024:2.0:1782727873.134152:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782727873.134201:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869325571993344:12345-0@lo:13: Request processed in 110us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727873.134211:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1782727873.134242:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782727873.134283:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d56f55e2d80 x1869325571993344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727873.134305:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325571993344:0@lo:13: 00000100:00100000:0.0:1782727873.137235:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325571993472:0@lo:400: 00000100:00100000:0.0:1782727873.137308:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727873.137370:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727873.137377:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869325571993600:0@lo:400: 00000100:00100000:0.0:1782727873.137402:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727873.137443:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869325571993728:0@lo:400: 00000100:00100000:0.0:1782727873.137445:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571993472 00000100:00100000:0.0:1782727873.137453:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571993472 00000100:00100000:2.0:1782727873.137482:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727873.137535:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782727873.137546:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:3316:x1869325571993472:12345-0@lo:400: 00000100:00100000:2.0:1782727873.137600:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571993600 00000100:00100000:0.0:1782727873.137604:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:3316:x1869325571993472:12345-0@lo:400: Request processed in 58us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727873.137605:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571993600 00000100:00100000:0.0:1782727873.137615:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782727873.137648:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571993728 00000100:00100000:0.0:1782727873.137651:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571993728 00000100:00100000:0.0:1782727873.137688:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782727873.137697:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869325571993728:12345-0@lo:400: 00000100:00100000:2.0:1782727873.137704:0:5806:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1782727873.137713:0:5806:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:2.0:1782727873.137732:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727873.137742:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869325571993728:12345-0@lo:400: Request processed in 47us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727873.137748:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782727873.137760:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782727873.137767:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869325571993600:12345-0@lo:400: 00000100:00100000:0.0:1782727873.137796:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869325571993600:12345-0@lo:400: Request processed in 30us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727873.137802:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1782727873.137843:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d56f5ae1f80 x1869325571993728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1782727873.137843:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d56f5ae0000 x1869325571993600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727873.137878:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869325571993728:0@lo:400: 00000100:00100000:0.0:1782727873.137895:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869325571993600:0@lo:400: 00000100:00100000:0.0:1782727873.137908:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325571993472:0@lo:400: 00000001:00080000:3.0:1782727873.247187:0:6630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1782727873.519192:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727874.541759:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727875.567340:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727876.590731:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727877.613759:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727878.254257:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325571993856:0@lo:13: 00000100:00100000:2.0:1782727878.254395:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727878.256798:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571993856 00000100:00100000:3.0:1782727878.256818:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571993856 00000100:00100000:1.0:1782727878.256932:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869325571994112:0@lo:400: 00000100:00100000:0.0:1782727878.256977:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325571993984:0@lo:400: 00000100:00100000:1.0:1782727878.257019:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727878.257019:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782727878.257070:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727878.257105:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782727878.257118:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325571993856:12345-0@lo:13: 00002000:00000024:2.0:1782727878.257165:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782727878.257666:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869325571994240:0@lo:400: 00000100:00100000:2.0:1782727878.267235:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325571993856:12345-0@lo:13: Request processed in 10105us (12824us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727878.267255:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782727878.269259:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571993984 00000100:00100000:0.0:1782727878.269287:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571993984 00000100:00100000:0.0:1782727878.269356:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782727878.269367:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:3316:x1869325571993984:12345-0@lo:400: 00000100:00100000:0.0:1782727878.269544:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:3316:x1869325571993984:12345-0@lo:400: Request processed in 178us (12525us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727878.269553:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782727878.269619:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325571993984:0@lo:400: 00000100:00100000:0.0:1782727878.270069:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571994112 00000100:00100000:0.0:1782727878.270075:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571994112 00000100:00100000:0.0:1782727878.270116:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782727878.270124:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869325571994112:12345-0@lo:400: 00000100:00100000:0.0:1782727878.270172:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869325571994112:12345-0@lo:400: Request processed in 48us (13153us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727878.270179:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782727878.271246:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727878.271310:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571994240 00000100:00100000:3.0:1782727878.271316:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571994240 00000100:00100000:3.0:1782727878.271371:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782727878.271380:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869325571994240:12345-0@lo:400: 00010000:00080000:2.0:1782727878.271731:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d56f55e1500 x1869325571993856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727878.271750:0:3315:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1782727878.271785:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325571993856:0@lo:13: 00000100:00080000:2.0:1782727878.271920:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727878.274061:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f55e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869325571994240:12345-0@lo:400: Request processed in 2670us (2807us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727878.274079:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1782727878.274165:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d56f59e7b80 x1869325571994240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727878.274200:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869325571994240:0@lo:400: 00010000:00080000:1.0:1782727878.277793:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d56f59e6300 x1869325571994112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727878.277817:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869325571994112:0@lo:400: 00010000:00010000:2.0:1782727878.639431:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727879.663540:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727880.687908:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727881.709755:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782727881.796229:0:7482:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782727881.796232:0:7482:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1782727881.796666:0:7482:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8d56d9e79800 00000020:01000004:2.0:1782727881.796682:0:7482:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1782727881.796694:0:7482:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1782727881.796706:0:7482:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d56c99d4d70) 00000020:00000080:2.0:1782727881.796718:0:7482:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1782727881.805651:0:7482:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1782727881.805872:0:7482:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1782727881.821206:0:7482:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1782727881.825836:0:7482:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1782727881.825875:0:7482:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1782727881.825935:0:7482:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1782727881.825962:0:7482:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1782727881.826306:0:7482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1782727881.826318:0:7482:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782727881.826329:0:7482:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x22171c6c29614c8f 00000020:01000004:2.0:1782727881.826336:0:7482:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1782727881.826357:0:7482:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.131@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1782727881.826360:0:7482:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1782727881.826372:0:7482:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1782727881.826392:0:7482:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1782727881.826395:0:7482:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.131@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1782727881.840776:0:7482:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.131@tcp ctxt 0 is initialized 00000020:01000004:1.0:1782727881.840812:0:7482:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.131@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1782727881.840815:0:7482:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1782727881.840816:0:7482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782727881.840818:0:7482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727881.840818:0:7482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782727881.840819:0:7482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727881.840820:0:7482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727881.840821:0:7482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782727881.840822:0:7482:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782727881.840823:0:7482:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782727881.840824:0:7482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727881.840825:0:7482:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782727881.840828:0:7482:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1782727881.840829:0:7482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782727881.840830:0:7482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782727881.840831:0:7482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782727881.840832:0:7482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782727881.840832:0:7482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782727881.840833:0:7482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782727881.840833:0:7482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782727881.840834:0:7482:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782727881.840835:0:7482:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782727881.840835:0:7482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782727881.840836:0:7482:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1782727881.840865:0:7482:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1782727881.840881:0:7482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571994368:0@lo:253: 00000100:00100000:1.0:1782727881.840944:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727881.840999:0:7482:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f9818f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782727881.841173:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571994368 00000100:00100000:0.0:1782727881.841181:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571994368 00000100:00100000:0.0:1782727881.841256:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782727881.841266:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:7482:x1869325571994368:12345-0@lo:253: 20000000:01000000:0.0:1782727881.841308:0:5800:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1782727881.841312:0:5800:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1782727881.841317:0:5800:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1782727881.841321:0:5800:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1782727881.842305:0:5800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782727881.842573:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1782727881.842588:0:5800:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1782727881.842630:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1782727881.842639:0:5800:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1782727881.842671:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1782727881.842723:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1782727881.843145:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1782727881.843167:0:5800:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.131@tcp 20000000:01000000:0.0:1782727881.843169:0:5800:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.131@tcp (null) (null) (null) 00000040:00080000:0.0:1782727881.843201:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1782727881.843209:0:5800:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1782727881.843282:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1782727881.843292:0:5800:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.131@tcp (null) (null) 00000040:00080000:0.0:1782727881.843331:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1782727881.843340:0:5800:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1782727881.843373:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1782727881.843423:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1782727881.844188:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1782727881.844207:0:5800:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.202.131@tcp 20000000:01000000:0.0:1782727881.844209:0:5800:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.202.131@tcp (null) (null) (null) 00000040:00080000:0.0:1782727881.844242:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1782727881.844636:0:5800:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1782727881.844682:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1782727881.844691:0:5800:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.131@tcp (null) (null) 00000040:00080000:0.0:1782727881.844721:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1782727881.844730:0:5800:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1782727881.844795:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1782727881.844836:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1782727881.844854:0:5800:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1782727881.844857:0:5800:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1782727881.844863:0:5800:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1782727881.844865:0:5800:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1782727881.844867:0:5800:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1782727881.844881:0:5800:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1782727881.844883:0:5800:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1782727881.844920:0:5800:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1782727881.844922:0:5800:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1782727881.845773:0:7484:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1782727881.845829:0:7484:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1782727881.845887:0:7484:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1782727881.846239:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1782727881.846296:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1782727881.846331:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1782727881.846344:0:5800:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1782727881.846346:0:5800:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1782727881.847322:0:7485:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1782727881.847410:0:7485:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1782727881.847443:0:7485:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1782727881.847910:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1782727881.847976:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1782727881.848055:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1782727881.848068:0:5800:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1782727881.848071:0:5800:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1782727881.849772:0:7486:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1782727881.849847:0:7486:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1782727881.849896:0:7486:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1782727881.850300:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1782727881.850337:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1782727881.850389:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1782727881.850403:0:5800:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1782727881.850405:0:5800:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1782727881.851067:0:7487:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1782727881.851256:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1782727881.851294:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1782727881.851353:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:0.0:1782727881.851374:0:5800:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1782727881.851397:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614c96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.851416:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d56cc3d8200/0x22171c6c29614bd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614bd2 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.851434:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d56c1666e00/0x22171c6c29614c03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614bfc expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.851441:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d56c1667000/0x22171c6c29614c2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614c26 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.851447:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d56c1667e00/0x22171c6c29614c49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614c42 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.851453:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d56c0031600/0x22171c6c29614c81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614c7a expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.851462:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614c96 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.851504:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d56c0031600/0x22171c6c29614c81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22171c6c29614c7a expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.851750:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d56c0031600/0x22171c6c29614c81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22171c6c29614c7a expref: 16 pid: 5798 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727881.851767:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5800:1869325571994496:0@lo:104: 00000100:00100000:0.0:1782727881.851855:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782727881.851914:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d56c1667e00/0x22171c6c29614c49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22171c6c29614c42 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.851923:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d56c1667e00/0x22171c6c29614c49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22171c6c29614c42 expref: 16 pid: 5798 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727881.851931:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5800:1869325571994624:0@lo:104: 00010000:00010000:0.0:1782727881.851962:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d56c1667000/0x22171c6c29614c2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22171c6c29614c26 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.851970:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d56c1667000/0x22171c6c29614c2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22171c6c29614c26 expref: 16 pid: 5800 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727881.851977:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5800:1869325571994752:0@lo:104: 00010000:00010000:0.0:1782727881.851998:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d56c1666e00/0x22171c6c29614c03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22171c6c29614bfc expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.852005:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d56c1666e00/0x22171c6c29614c03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22171c6c29614bfc expref: 16 pid: 5800 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727881.852013:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5800:1869325571994880:0@lo:104: 00010000:00010000:0.0:1782727881.852034:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d56cc3d8200/0x22171c6c29614bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22171c6c29614bd2 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.852042:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d56cc3d8200/0x22171c6c29614bd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22171c6c29614bd2 expref: 16 pid: 5801 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727881.852049:0:5800:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae2d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5800:1869325571995008:0@lo:104: 00000100:00100000:0.0:1782727881.852064:0:5800:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d826e480 going to sleep for 11 seconds 00000100:00100000:2.0:1782727881.852117:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782727881.852136:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727881.852200:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727881.852259:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727881.852279:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571994496 00000100:00100000:1.0:1782727881.852287:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571994496 00000100:00100000:1.0:1782727881.852325:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571994624 00000100:00100000:1.0:1782727881.852329:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571994624 00000100:00100000:1.0:1782727881.852340:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571994752 00000100:00100000:1.0:1782727881.852342:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571994752 00000100:00100000:1.0:1782727881.852356:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782727881.852376:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c93a6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+5:5800:x1869325571994496:12345-0@lo:104: 00010000:00010000:1.0:1782727881.852390:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9e00/0x22171c6c29614c7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614c81 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727881.852473:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782727881.852479:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c93a6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+5:5800:x1869325571994496:12345-0@lo:104: Request processed in 105us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727881.852487:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1782727881.852644:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727881.852652:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9e00/0x22171c6c29614c7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614c81 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.852660:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56cc3d9e00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:3.0:1782727881.852664:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9e00/0x22171c6c29614c7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x22171c6c29614c81 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.852674:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9e00/0x22171c6c29614c7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x22171c6c29614c81 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727881.852682:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9e00/0x22171c6c29614c7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x22171c6c29614c81 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727881.852688:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727881.852717:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9e00/0x22171c6c29614c7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614c81 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.852734:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727881.852752:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9e00/0x22171c6c29614c7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614c81 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.852760:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9e00/0x22171c6c29614c7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614c81 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.852774:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727881.852776:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727881.852778:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727881.852786:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782727881.852798:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325571995136:0@lo:103: 00000100:00100000:3.0:1782727881.852828:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727881.852898:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782727881.852907:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+4:5800:x1869325571994624:12345-0@lo:104: 00010000:00010000:1.0:1782727881.852915:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8d56c1666600/0x22171c6c29614c42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614c49 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727881.852962:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782727881.852967:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+4:5800:x1869325571994624:12345-0@lo:104: Request processed in 63us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727881.852973:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782727881.852987:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782727881.852993:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+3:5800:x1869325571994752:12345-0@lo:104: 00010000:00010000:1.0:1782727881.853000:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8d56c0030000/0x22171c6c29614c26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614c2d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727881.853028:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782727881.853033:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+3:5800:x1869325571994752:12345-0@lo:104: Request processed in 41us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727881.853039:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782727881.853059:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571995136 00000100:00100000:1.0:1782727881.853069:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571995136 00010000:00010000:1.0:1782727881.853087:0:6620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d56c0031600/0x22171c6c29614c81 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614c7a expref: 17 pid: 5798 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727881.853107:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782727881.853112:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:3314:x1869325571995136:12345-0@lo:103: 00010000:00010000:1.0:1782727881.853123:0:6620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727881.853128:0:6620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d56c0031600/0x22171c6c29614c81 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614c7a expref: 17 pid: 5798 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727881.853138:0:6620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d56c0031600/0x22171c6c29614c81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22171c6c29614c7a expref: 17 pid: 5798 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727881.853155:0:6620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727881.853180:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f55e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:3314:x1869325571995136:12345-0@lo:103: Request processed in 68us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727881.853186:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1782727881.853240:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782727881.853255:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8d56c1666600/0x22171c6c29614c42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614c49 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.853263:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56c1666600 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:3.0:1782727881.853266:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8d56c1666600/0x22171c6c29614c42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x22171c6c29614c49 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.853273:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8d56c1666600/0x22171c6c29614c42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x22171c6c29614c49 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727881.853278:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8d56c1666600/0x22171c6c29614c42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x22171c6c29614c49 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727881.853283:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727881.853299:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8d56c1666600/0x22171c6c29614c42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614c49 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.853312:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727881.853337:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8d56c1666600/0x22171c6c29614c42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614c49 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.853344:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8d56c1666600/0x22171c6c29614c42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614c49 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.853357:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727881.853360:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8d56c0030000/0x22171c6c29614c26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614c2d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.853366:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56c0030000 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:3.0:1782727881.853369:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8d56c0030000/0x22171c6c29614c26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x22171c6c29614c2d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.853375:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8d56c0030000/0x22171c6c29614c26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x22171c6c29614c2d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727881.853381:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8d56c0030000/0x22171c6c29614c26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x22171c6c29614c2d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727881.853387:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727881.853400:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8d56c0030000/0x22171c6c29614c26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614c2d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.853407:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727881.853412:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8d56c0030000/0x22171c6c29614c26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614c2d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.853418:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8d56c0030000/0x22171c6c29614c26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614c2d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.853436:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727881.853438:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727881.853440:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727881.853452:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3317:1869325571995392:0@lo:103: 00000100:00100000:3.0:1782727881.853478:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727881.853498:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782727881.853503:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3317:1869325571995264:0@lo:103: 00000100:00100000:3.0:1782727881.853661:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727881.853712:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325571995136:0@lo:103: 00010000:00010000:3.0:1782727881.853731:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727881.853770:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571995392 00000100:00100000:1.0:1782727881.853774:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571995392 00010000:00010000:1.0:1782727881.853790:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d56c1667000/0x22171c6c29614c2d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614c26 expref: 17 pid: 5800 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727881.853894:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571995264 00000100:00100000:1.0:1782727881.853897:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571995264 00010000:00010000:1.0:1782727881.853908:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d56c1667e00/0x22171c6c29614c49 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614c42 expref: 18 pid: 5798 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727881.853982:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727881.853993:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571994880 00000100:00100000:2.0:1782727881.853996:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571994880 00000100:00100000:2.0:1782727881.854015:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571995008 00000100:00100000:2.0:1782727881.854018:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571995008 00000100:00100000:2.0:1782727881.854030:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782727881.854037:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+4:5800:x1869325571994880:12345-0@lo:104: 00010000:00010000:2.0:1782727881.854045:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614bfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614c03 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.854082:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782727881.854086:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+4:5800:x1869325571994880:12345-0@lo:104: Request processed in 52us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727881.854093:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782727881.854107:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782727881.854112:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+3:5800:x1869325571995008:12345-0@lo:104: 00010000:00010000:2.0:1782727881.854119:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9200/0x22171c6c29614bd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614bd9 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.854150:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782727881.854154:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+3:5800:x1869325571995008:12345-0@lo:104: Request processed in 43us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727881.854170:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782727881.854267:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782727881.854276:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:3317:x1869325571995392:12345-0@lo:103: 00010000:00010000:3.0:1782727881.854285:0:6620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727881.854291:0:6620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d56c1667000/0x22171c6c29614c2d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614c26 expref: 18 pid: 5800 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.854298:0:6620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d56c1667000/0x22171c6c29614c2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22171c6c29614c26 expref: 18 pid: 5800 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.854310:0:6620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727881.854337:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f55e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:3317:x1869325571995392:12345-0@lo:103: Request processed in 64us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727881.854342:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782727881.854354:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782727881.854359:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:3317:x1869325571995264:12345-0@lo:103: 00010000:00010000:3.0:1782727881.854365:0:6620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727881.854375:0:6620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d56c1667e00/0x22171c6c29614c49 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614c42 expref: 17 pid: 5798 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.854383:0:6620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d56c1667e00/0x22171c6c29614c49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22171c6c29614c42 expref: 17 pid: 5798 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.854391:0:6620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727881.854412:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f55e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:3317:x1869325571995264:12345-0@lo:103: Request processed in 53us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727881.854418:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782727881.854446:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3317:1869325571995264:0@lo:103: 00000100:00100000:3.0:1782727881.854454:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3317:1869325571995392:0@lo:103: 00010000:00010000:0.0:1782727881.854562:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56c0031600/0x22171c6c29614c81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22171c6c29614c7a expref: 16 pid: 5798 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727881.854576:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5800:1869325571994496:0@lo:104: 00010000:00010000:0.0:1782727881.854587:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56c1667e00/0x22171c6c29614c49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22171c6c29614c42 expref: 15 pid: 5798 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727881.854610:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5800:1869325571994624:0@lo:104: 00010000:00010000:0.0:1782727881.854622:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56c1667000/0x22171c6c29614c2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22171c6c29614c26 expref: 14 pid: 5800 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727881.854630:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5800:1869325571994752:0@lo:104: 00000100:00100000:0.0:1782727881.854637:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5800:1869325571994880:0@lo:104: 00000100:00100000:0.0:1782727881.854644:0:5800:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae2d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5800:1869325571995008:0@lo:104: 00010000:00010000:0.0:1782727881.854665:0:5800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614c96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.855087:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782727881.855094:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614bfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614c03 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.855103:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3cfa00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:2.0:1782727881.855107:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614bfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x22171c6c29614c03 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.855116:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614bfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x22171c6c29614c03 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782727881.855123:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614bfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x22171c6c29614c03 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727881.855129:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782727881.855164:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614bfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614c03 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.855171:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782727881.855226:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325571995520:0@lo:103: 00000100:00100000:1.0:1782727881.855276:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782727881.855325:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614bfc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614c03 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.855333:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614bfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614c03 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.855343:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782727881.855347:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9200/0x22171c6c29614bd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614bd9 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.855365:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56cc3d9200 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:2.0:1782727881.855369:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9200/0x22171c6c29614bd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x22171c6c29614bd9 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.855376:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9200/0x22171c6c29614bd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x22171c6c29614bd9 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782727881.855382:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9200/0x22171c6c29614bd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x22171c6c29614bd9 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727881.855387:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782727881.855401:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9200/0x22171c6c29614bd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614bd9 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.855407:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782727881.855453:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571995520 00000100:00100000:0.0:1782727881.855458:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571995520 00010000:00010000:0.0:1782727881.855478:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d56c1666e00/0x22171c6c29614c03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614bfc expref: 14 pid: 5800 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727881.855502:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782727881.855530:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:3314:x1869325571995520:12345-0@lo:103: 00010000:00010000:0.0:1782727881.855551:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727881.855557:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d56c1666e00/0x22171c6c29614c03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614bfc expref: 14 pid: 5800 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.855567:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d56c1666e00/0x22171c6c29614c03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22171c6c29614bfc expref: 14 pid: 5800 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.855579:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56c1666e00/0x22171c6c29614c03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22171c6c29614bfc expref: 14 pid: 5800 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.855600:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782727881.855818:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9200/0x22171c6c29614bd2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614bd9 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.855826:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9200/0x22171c6c29614bd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614bd9 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.855840:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727881.855842:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727881.855843:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727881.855853:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3315:1869325571995648:0@lo:103: 00000100:00100000:2.0:1782727881.855881:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727881.855961:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:3314:x1869325571995520:12345-0@lo:103: Request processed in 452us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727881.855969:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782727881.855984:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571995648 00000100:00100000:0.0:1782727881.855988:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571995648 00010000:00010000:0.0:1782727881.856001:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d56cc3d8200/0x22171c6c29614bd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614bd2 expref: 13 pid: 5801 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727881.856025:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782727881.856031:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:3315:x1869325571995648:12345-0@lo:103: 00010000:00010000:0.0:1782727881.856039:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727881.856043:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d56cc3d8200/0x22171c6c29614bd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614bd2 expref: 13 pid: 5801 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.856053:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d56cc3d8200/0x22171c6c29614bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22171c6c29614bd2 expref: 13 pid: 5801 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.856063:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56cc3d8200/0x22171c6c29614bd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22171c6c29614bd2 expref: 13 pid: 5801 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.856076:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614c96 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.856084:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614c96 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.856098:0:5791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614c96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.856116:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614c96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.856122:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614c96 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.856128:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614c96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.856133:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56c0030e00 already unused, calling callback (ffffffffc152fcf0) 00010000:00010000:0.0:1782727881.856139:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614c96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.856147:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614c96 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.856161:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614c96 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.856171:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727881.856200:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:3315:x1869325571995648:12345-0@lo:103: Request processed in 169us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727881.856206:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782727881.856237:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3315:1869325571995648:0@lo:103: 00010000:00010000:0.0:1782727881.856277:0:5800:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614c96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.856285:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614c96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.856300:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614c96 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782727881.856314:0:5800:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1782727881.856944:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325571995520:0@lo:103: 00010000:00010000:3.0:1782727881.859302:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727881.899413:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:7482:x1869325571994368:12345-0@lo:253: Request processed in 58136us (58456us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727881.899429:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782727881.899641:0:7482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571994368:0@lo:253: 10000000:01000000:3.0:1782727881.899658:0:7482:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1782727881.899661:0:7482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782727881.899662:0:7482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782727881.899664:0:7482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782727881.899665:0:7482:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1782727881.899666:0:7482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782727881.899667:0:7482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782727881.899669:0:7482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782727881.899670:0:7482:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1782727881.899672:0:7482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782727881.899673:0:7482:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782727881.899694:0:7482:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d56d9e79800 from lustre-OST0001 10000000:01000000:3.0:1782727881.899719:0:7482:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1782727881.899723:0:7482:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1782727881.899732:0:7482:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d56d0964d70 local copy 10000000:01000000:3.0:1782727881.899736:0:7482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782727881.899778:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d57021c0a00/0x22171c6c29614c9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.899797:0:7482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.131@tcp lock: ffff8d57021c0a00/0x22171c6c29614c9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.899808:0:7482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d57021c0a00/0x22171c6c29614c9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727881.899828:0:7482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571995776:0@lo:101: 00000100:00100000:3.0:1782727881.899866:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727881.899905:0:7482:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c2ae4840 going to sleep for 11 seconds 00000100:00100000:0.0:1782727881.899922:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571995776 00000100:00100000:0.0:1782727881.899929:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571995776 00000100:00100000:0.0:1782727881.899974:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782727881.900118:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+11:7482:x1869325571995776:12345-0@lo:101: 00010000:00010000:0.0:1782727881.900133:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727881.900147:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614ca4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614c9d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.900172:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614ca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614c9d expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.900183:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614ca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614c9d expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.900191:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56c0030e00, rc 0) 00000100:00100000:0.0:1782727881.900233:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:7482:x1869325571995776:12345-0@lo:101: Request processed in 119us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727881.900240:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782727881.900275:0:7482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571995776:0@lo:101: 00010000:00010000:3.0:1782727881.900289:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d57021c0a00/0x22171c6c29614c9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x22171c6c29614ca4 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.900299:0:7482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d57021c0a00/0x22171c6c29614c9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x22171c6c29614ca4 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727881.900383:0:7482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571995904:0@lo:501: 00000100:00100000:3.0:1782727881.900402:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727881.900419:0:7482:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c2ae4840 going to sleep for 11 seconds 00000100:00100000:2.0:1782727881.900461:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571995904 00000100:00100000:2.0:1782727881.900465:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571995904 00000100:00100000:2.0:1782727881.900502:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782727881.900603:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:7482:x1869325571995904:12345-0@lo:501: 00000100:00100000:2.0:1782727881.900812:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:7482:x1869325571995904:12345-0@lo:501: Request processed in 304us (408us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782727881.900817:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782727881.900955:0:7482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571995904:0@lo:501: 10000000:01000000:3.0:1782727881.900966:0:7482:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782727881.900989:0:7482:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782727881.900994:0:7482:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d57021c0a00/0x22171c6c29614c9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x22171c6c29614ca4 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.901003:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d57021c0a00/0x22171c6c29614c9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x22171c6c29614ca4 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.901017:0:7482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.131@tcp lock: ffff8d57021c0a00/0x22171c6c29614c9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x22171c6c29614ca4 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.901074:0:7482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782727881.901095:0:7482:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d56d9e79800 10000000:01000000:3.0:1782727881.901100:0:7482:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782727881.901105:0:7482:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1782727881.901107:0:7482:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782727881.901112:0:7482:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1782727881.901114:0:7482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1782727881.901128:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d57021c1800/0x22171c6c29614cab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.901134:0:7482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d57021c1800/0x22171c6c29614cab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.901140:0:7482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d57021c1800/0x22171c6c29614cab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727881.901148:0:7482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571996032:0@lo:101: 00000100:00100000:3.0:1782727881.901168:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727881.901203:0:7482:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c2ae46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727881.901211:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571996032 00000100:00100000:0.0:1782727881.901215:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571996032 00000100:00100000:0.0:1782727881.901262:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782727881.901270:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:7482:x1869325571996032:12345-0@lo:101: 00010000:00010000:0.0:1782727881.901277:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727881.901287:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56c0031600/0x22171c6c29614cb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614cab expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.901315:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56c0031600/0x22171c6c29614cb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614cab expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.901324:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56c0031600/0x22171c6c29614cb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614cab expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.901331:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56c0031600, rc 0) 00010000:00010000:2.0:1782727881.901334:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782727881.901340:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8d57021c0a00/0x22171c6c29614c9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x22171c6c29614ca4 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.901347:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d57021c0a00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:2.0:1782727881.901351:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8d57021c0a00/0x22171c6c29614c9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x22171c6c29614ca4 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.901360:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8d57021c0a00/0x22171c6c29614c9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x22171c6c29614ca4 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727881.901366:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:7482:x1869325571996032:12345-0@lo:101: Request processed in 98us (197us total) trans 0 rc 0/0 10000000:00010000:2.0:1782727881.901367:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8d57021c0a00/0x22171c6c29614c9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x22171c6c29614ca4 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727881.901372:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 10000000:01000000:2.0:1782727881.901373:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782727881.901391:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8d57021c0a00/0x22171c6c29614c9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x22171c6c29614ca4 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.901398:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782727881.901437:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325571996160:0@lo:103: 00000100:00100000:1.0:1782727881.901464:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727881.901545:0:7482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571996032:0@lo:101: 00010000:00010000:3.0:1782727881.901555:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d57021c1800/0x22171c6c29614cab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614cb2 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.901563:0:7482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d57021c1800/0x22171c6c29614cab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614cb2 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727881.901631:0:7482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571996288:0@lo:501: 00000100:00100000:3.0:1782727881.901650:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727881.901663:0:7482:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c2ae46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727881.901777:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571996160 00000100:00100000:0.0:1782727881.901783:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571996160 00000100:00100000:0.0:1782727881.901823:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782727881.901831:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:3316:x1869325571996160:12345-0@lo:103: 00010000:00010000:0.0:1782727881.901840:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727881.901853:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614ca4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x22171c6c29614c9d expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.901867:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782727881.901972:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8d57021c0a00/0x22171c6c29614c9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x22171c6c29614ca4 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.901979:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8d57021c0a00/0x22171c6c29614c9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x22171c6c29614ca4 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.901996:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727881.901998:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727881.901999:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727881.902110:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:3316:x1869325571996160:12345-0@lo:103: Request processed in 279us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727881.902117:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782727881.902137:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571996288 00000100:00100000:0.0:1782727881.902141:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571996288 00000100:00100000:0.0:1782727881.902171:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782727881.902178:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:7482:x1869325571996288:12345-0@lo:501: 00000100:00100000:0.0:1782727881.902434:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:7482:x1869325571996288:12345-0@lo:501: Request processed in 256us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727881.902448:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782727881.902566:0:7482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571996288:0@lo:501: 00000100:00100000:3.0:1782727881.902622:0:7482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571996416:0@lo:503: 00000100:00100000:3.0:1782727881.902664:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727881.902683:0:7482:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c2ae46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727881.902839:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571996416 00000100:00100000:0.0:1782727881.902844:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571996416 00000100:00100000:0.0:1782727881.902869:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782727881.902875:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:7482:x1869325571996416:12345-0@lo:503: 00000100:00100000:0.0:1782727881.903029:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:7482:x1869325571996416:12345-0@lo:503: Request processed in 153us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727881.903036:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782727881.903078:0:7482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571996416:0@lo:503: 00000040:00080000:0.0:1782727881.903371:0:7482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782727881.903434:0:7482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571996544:0@lo:502: 00000100:00100000:0.0:1782727881.903472:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727881.903497:0:7482:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d826e180 going to sleep for 11 seconds 00000100:00100000:0.0:1782727881.903812:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571996544 00000100:00100000:0.0:1782727881.903819:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571996544 00000100:00100000:0.0:1782727881.903893:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782727881.903902:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:7482:x1869325571996544:12345-0@lo:502: 00000100:00100000:0.0:1782727881.904079:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:7482:x1869325571996544:12345-0@lo:502: Request processed in 179us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727881.904086:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782727881.904183:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325571996160:0@lo:103: 00000100:00100000:3.0:1782727881.904281:0:7482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571996544:0@lo:502: 00000040:00080000:3.0:1782727881.904474:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1782727881.904550:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1782727881.904588:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1782727881.904628:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1782727881.904648:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1782727881.904664:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1782727881.904685:0:7482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571996672:0@lo:502: 00000100:00100000:3.0:1782727881.904717:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727881.904955:0:7482:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c2ae4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782727881.905031:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571996672 00000100:00100000:2.0:1782727881.905037:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571996672 00000100:00100000:2.0:1782727881.905066:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782727881.905074:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:7482:x1869325571996672:12345-0@lo:502: 00000100:00100000:2.0:1782727881.905328:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:7482:x1869325571996672:12345-0@lo:502: Request processed in 253us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727881.905335:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782727881.905389:0:7482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571996672:0@lo:502: 00000040:00080000:3.0:1782727881.905456:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1782727881.905465:0:7482:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1782727881.905969:0:7489:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782727881.905977:0:7489:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1782727881.905981:0:7489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727881.905983:0:7489:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1782727881.905987:0:7489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782727881.905998:0:7489:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d56c93b8000) 00000020:00000080:1.0:1782727881.906015:0:7489:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1782727881.906019:0:7489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782727881.906079:0:7489:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d56d9e79800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1782727881.906084:0:7489:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1782727881.906094:0:7489:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x22171c6c29614cc0 00010000:00010000:1.0:1782727881.908472:0:7489:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1782727881.908795:0:7489:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1782727881.910905:0:7489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1782727881.911121:0:7489:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1782727881.913488:0:7489:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1782727881.914025:0:7489:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1782727881.917665:0:7489:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1782727881.917680:0:7489:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727881.917694:0:7489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727881.917696:0:7489:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1782727881.917703:0:7489:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727881.917707:0:7489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727881.917709:0:7489:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782727881.917712:0:7489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782727881.917714:0:7489:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782727881.917774:0:7489:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727881.917783:0:7489:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727881.917784:0:7489:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782727881.917789:0:7489:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1782727881.917971:0:7482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1782727881.918001:0:7482:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1782727881.918025:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d57021c1800/0x22171c6c29614cab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614cb2 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727881.918038:0:7482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d57021c1800/0x22171c6c29614cab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614cb2 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727881.918047:0:7482:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8d56d9e79800 from 1 10000000:01000000:1.0:1782727881.918050:0:7482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782727881.918089:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8200/0x22171c6c29614cc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727881.918098:0:7482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8200/0x22171c6c29614cc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727881.918117:0:7482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8200/0x22171c6c29614cc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727881.918140:0:7482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571996800:0@lo:101: 00000100:00100000:1.0:1782727881.918220:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727881.918267:0:7482:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f9818b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782727881.918322:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571996800 00000100:00100000:0.0:1782727881.918329:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571996800 00000100:00100000:0.0:1782727881.918370:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782727881.918378:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:7482:x1869325571996800:12345-0@lo:101: 00010000:00010000:0.0:1782727881.918392:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727881.918407:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614cce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614cc7 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.918431:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614cce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614cc7 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.918441:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614cce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614cc7 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.918449:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56c0030e00, rc 0) 00000100:00100000:0.0:1782727881.918489:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:7482:x1869325571996800:12345-0@lo:101: Request processed in 111us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727881.918495:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782727881.918620:0:7482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571996800:0@lo:101: 00010000:00010000:0.0:1782727881.918636:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8200/0x22171c6c29614cc7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614cce expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.918652:0:7482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8200/0x22171c6c29614cc7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614cce expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727881.918744:0:7482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571996928:0@lo:501: 00000100:00100000:0.0:1782727881.918767:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727881.918794:0:7482:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d826e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727881.918831:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571996928 00000100:00100000:1.0:1782727881.918834:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571996928 00000100:00100000:1.0:1782727881.918862:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1782727881.918867:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:7482:x1869325571996928:12345-0@lo:501: 00000100:00100000:1.0:1782727881.919042:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:7482:x1869325571996928:12345-0@lo:501: Request processed in 174us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727881.919046:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782727881.919095:0:7482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571996928:0@lo:501: 00000100:00100000:0.0:1782727881.919114:0:7482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571997056:0@lo:503: 00000100:00100000:0.0:1782727881.919141:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727881.919156:0:7482:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d826e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727881.919185:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571997056 00000100:00100000:1.0:1782727881.919188:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571997056 00000100:00100000:1.0:1782727881.919253:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1782727881.919260:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:7482:x1869325571997056:12345-0@lo:503: 00000100:00100000:1.0:1782727881.919486:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:7482:x1869325571997056:12345-0@lo:503: Request processed in 226us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727881.919493:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1782727881.919619:0:7482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571997056:0@lo:503: 00000040:00080000:0.0:1782727881.919838:0:7482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782727881.919882:0:7482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571997184:0@lo:502: 00000100:00100000:0.0:1782727881.919910:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727881.919934:0:7482:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d826e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727881.919953:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571997184 00000100:00100000:2.0:1782727881.919958:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571997184 00000100:00100000:2.0:1782727881.919991:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782727881.919999:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:7482:x1869325571997184:12345-0@lo:502: 00000100:00100000:0.0:1782727881.920752:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:7482:x1869325571997184:12345-0@lo:502: Request processed in 752us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727881.920761:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1782727881.920847:0:7482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571997184:0@lo:502: 00000040:00080000:1.0:1782727881.921111:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1782727881.921166:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1782727881.921195:0:7482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571997312:0@lo:502: 00000100:00100000:1.0:1782727881.921234:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727881.921316:0:7482:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f98183c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727881.925329:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571997312 00000100:00100000:0.0:1782727881.925344:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571997312 00000100:00100000:0.0:1782727881.925425:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1782727881.925434:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:7482:x1869325571997312:12345-0@lo:502: 00000100:00100000:0.0:1782727881.925924:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:7482:x1869325571997312:12345-0@lo:502: Request processed in 488us (4687us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727881.925932:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1782727881.926067:0:7482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571997312:0@lo:502: 00000040:00080000:2.0:1782727881.926230:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1782727881.926256:0:7482:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1782727881.927166:0:7493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782727881.927176:0:7493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727881.927179:0:7493:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782727881.927185:0:7493:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d56d9e79800 00000020:00000080:1.0:1782727881.927188:0:7493:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782727881.927208:0:7493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727881.927212:0:7493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727881.927213:0:7493:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1782727881.927216:0:7493:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1782727881.927351:0:7482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1782727881.927375:0:7482:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782727881.927404:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8200/0x22171c6c29614cc7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614cce expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.927417:0:7482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8200/0x22171c6c29614cc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614cce expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727881.927465:0:7482:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782727881.927468:0:7482:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d56d9e79800 10000000:01000000:2.0:1782727881.927487:0:7482:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d56d9e79800 10000000:01000000:2.0:1782727881.927491:0:7482:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782727881.927498:0:7482:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8d56d9e79800 from 1 10000000:01000000:2.0:1782727881.927501:0:7482:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782727881.927571:0:7482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614cd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.927581:0:7482:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614cd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.927591:0:7482:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614cd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727881.927614:0:7482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571997440:0@lo:101: 00000100:00100000:2.0:1782727881.927677:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727881.927721:0:7482:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56df325000 going to sleep for 11 seconds 00000100:00100000:1.0:1782727881.927806:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571997440 00000100:00100000:1.0:1782727881.927813:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571997440 00000100:00100000:1.0:1782727881.927849:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782727881.927858:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:7482:x1869325571997440:12345-0@lo:101: 00010000:00010000:1.0:1782727881.927873:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727881.927888:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56cc3d9e00/0x22171c6c29614cdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614cd5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727881.927919:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56cc3d9e00/0x22171c6c29614cdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614cd5 expref: 14 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727881.927931:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56cc3d9e00/0x22171c6c29614cdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614cd5 expref: 14 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727881.927941:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56cc3d9e00, rc 0) 00000100:00100000:1.0:1782727881.927988:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:7482:x1869325571997440:12345-0@lo:101: Request processed in 130us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727881.927994:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782727881.928220:0:7482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571997440:0@lo:101: 00010000:00010000:3.0:1782727881.928236:0:7482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614cd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614cdc expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.928255:0:7482:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614cd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614cdc expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727881.928353:0:7482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571997568:0@lo:501: 00000100:00100000:3.0:1782727881.928383:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727881.928447:0:7482:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c2ae4840 going to sleep for 11 seconds 00000100:00100000:0.0:1782727881.928478:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571997568 00000100:00100000:0.0:1782727881.928482:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571997568 00000100:00100000:0.0:1782727881.928659:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1782727881.928668:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:7482:x1869325571997568:12345-0@lo:501: 00000100:00100000:0.0:1782727881.928916:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:7482:x1869325571997568:12345-0@lo:501: Request processed in 249us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727881.928924:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782727881.929040:0:7482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571997568:0@lo:501: 00000100:00100000:3.0:1782727881.929075:0:7482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571997696:0@lo:503: 00000100:00100000:3.0:1782727881.929117:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727881.929228:0:7482:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c2ae4840 going to sleep for 11 seconds 00000100:00100000:1.0:1782727881.929307:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571997696 00000100:00100000:1.0:1782727881.929313:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571997696 00000100:00100000:1.0:1782727881.929339:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1782727881.929354:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:7482:x1869325571997696:12345-0@lo:503: 00000100:00100000:1.0:1782727881.929559:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:7482:x1869325571997696:12345-0@lo:503: Request processed in 206us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727881.929565:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782727881.929659:0:7482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571997696:0@lo:503: 00000040:00080000:3.0:1782727881.929927:0:7482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782727881.929992:0:7482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571997824:0@lo:502: 00000100:00100000:3.0:1782727881.930030:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727881.930060:0:7482:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c2ae4840 going to sleep for 11 seconds 00000100:00100000:1.0:1782727881.930109:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571997824 00000100:00100000:1.0:1782727881.930115:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571997824 00000100:00100000:1.0:1782727881.930135:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782727881.930142:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:7482:x1869325571997824:12345-0@lo:502: 00000100:00100000:1.0:1782727881.930331:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:7482:x1869325571997824:12345-0@lo:502: Request processed in 189us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727881.930339:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782727881.930454:0:7482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571997824:0@lo:502: 00000040:00080000:3.0:1782727881.930753:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1782727881.930803:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1782727881.930837:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1782727881.930881:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1782727881.930916:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1782727881.930960:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1782727881.930995:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1782727881.931028:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1782727881.931076:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1782727881.931114:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1782727881.931143:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1782727881.931185:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1782727881.931219:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1782727881.931278:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1782727881.931326:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1782727881.931364:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1782727881.931399:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1782727881.931458:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1782727881.931498:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1782727881.931561:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1782727881.931625:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1782727881.931664:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1782727881.931699:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1782727881.931748:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1782727881.931786:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1782727881.931821:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1782727881.931869:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1782727881.931904:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1782727881.931944:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1782727881.932009:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1782727881.932046:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1782727881.932080:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1782727881.932116:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1782727881.932160:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1782727881.932189:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1782727881.932236:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1782727881.932285:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1782727881.932328:0:7482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571997952:0@lo:502: 00000100:00100000:3.0:1782727881.932399:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727881.932431:0:7482:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c2ae4840 going to sleep for 11 seconds 00000100:00100000:0.0:1782727881.932569:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571997952 00000100:00100000:0.0:1782727881.932576:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571997952 00000100:00100000:0.0:1782727881.932624:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1782727881.932633:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:7482:x1869325571997952:12345-0@lo:502: 00000100:00100000:0.0:1782727881.932844:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:7482:x1869325571997952:12345-0@lo:502: Request processed in 211us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727881.932851:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782727881.933022:0:7482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571997952:0@lo:502: 00000040:00080000:3.0:1782727881.933097:0:7482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1782727881.933107:0:7482:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1782727881.934129:0:7494:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1782727881.934156:0:7494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d5700c44d70) 00000020:00000080:1.0:1782727881.934182:0:7494:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1782727881.934436:0:7494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d56d9e79800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782727881.934440:0:7494:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d56d9e79800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782727881.934443:0:7494:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8d56d9e79800 3 00010000:00080000:1.0:1782727881.934478:0:7494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d5700c4f800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.131@tcp at head 00010000:00010000:1.0:1782727881.936174:0:7494:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1782727881.936299:0:7494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1782727881.936334:0:7494:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782727881.936347:0:7494:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x22171c6c29614cea 00000100:00080000:1.0:1782727881.936359:0:7494:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782727881.936365:0:7494:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d5700c4f800 using connection 192.168.202.131@tcp/0@lo 00000100:00100000:1.0:1782727881.936408:0:7494:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d56f59e7480 x1869325571998080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782727881.936431:0:7494:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1782727881.936653:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727881.936671:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869325571998208:0@lo:400: 00000100:00100000:0.0:1782727881.936740:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727881.936785:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869325571998336:0@lo:400: 00000100:00100000:0.0:1782727881.936814:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727881.936832:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727881.936838:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325571998464:0@lo:400: 00000100:00100000:0.0:1782727881.936864:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727881.936893:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571998208 00000100:00100000:0.0:1782727881.936900:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571998208 00000100:00100000:0.0:1782727881.936939:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571998336 00000100:00100000:0.0:1782727881.936943:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571998336 00000100:00100000:0.0:1782727881.936977:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782727881.936987:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869325571998208:12345-0@lo:400: 00000100:00100000:0.0:1782727881.937056:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869325571998208:12345-0@lo:400: Request processed in 70us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727881.937064:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782727881.937079:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782727881.937085:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869325571998336:12345-0@lo:400: 00000100:00100000:0.0:1782727881.937113:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869325571998336:12345-0@lo:400: Request processed in 29us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727881.937119:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782727881.937142:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571998464 00000100:00100000:0.0:1782727881.937146:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571998464 00000100:00100000:0.0:1782727881.937170:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782727881.937177:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325571998464:12345-0@lo:400: 00000100:00100000:0.0:1782727881.937205:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325571998464:12345-0@lo:400: Request processed in 29us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727881.937211:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1782727881.937229:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782727881.937233:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782727881.937275:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d56f5ae1c00 x1869325571998464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727881.937288:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325571998464:0@lo:400: 00010000:00080000:0.0:1782727881.937299:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d56f5ae0000 x1869325571998336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727881.937307:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869325571998336:0@lo:400: 00010000:00080000:0.0:1782727881.937336:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d56f5ae3800 x1869325571998208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727881.937356:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869325571998208:0@lo:400: 00000040:00080000:0.0:1782727881.937664:0:7494:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:0.0:1782727881.937826:0:7495:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8d56f5ae3800 x1869325571998592/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727881.937835:0:7495:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c7d3a0c0 going to sleep for 0 seconds 00000100:00100000:2.0:1782727881.937930:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1869325571998080:0@lo:38: 00000100:00100000:2.0:1782727881.937971:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727881.938061:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571998080 00000100:00100000:0.0:1782727881.938065:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571998080 00000100:00100000:0.0:1782727881.938096:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782727881.938101:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1869325571998080:12345-0@lo:38: 00010000:00080000:0.0:1782727881.938124:0:5808:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:0.0:1782727881.938156:0:5808:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x22171c6c29614cf1 00000004:00100000:0.0:1782727881.938173:0:5808:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1782727881.938202:0:5808:0:(import.c:65:import_set_state_nolock()) ffff8d56ffb72800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782727881.938256:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869325571998080:12345-0@lo:38: Request processed in 144us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727881.938263:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1782727881.938295:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d56f59e7480 x1869325571998080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782727891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727881.938303:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782727881.938309:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1782727881.938316:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1782727881.938320:0:3313:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782727881.938323:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8d5700c4f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1782727881.938329:0:3313:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007c9a09d4): req@ffff8d56f5ae3800 x1869325571998592/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727881.938358:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1869325571998080:0@lo:38: 00000100:00100000:0.0:1782727881.938402:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727881.938440:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571998592 00000100:00100000:0.0:1782727881.938445:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571998592 00000100:00100000:0.0:1782727881.938479:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782727881.938485:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7495:x1869325571998592:12345-0@lo:901: 00000100:00100000:0.0:1782727881.938858:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7495:x1869325571998592:12345-0@lo:901: Request processed in 372us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727881.938864:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1782727881.938882:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782727881.938928:0:7495:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d56f5ae3800 x1869325571998592/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1782727897 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727881.938937:0:7495:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae3800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7495:1869325571998592:0@lo:901: 00000020:01000000:2.0:1782727881.939187:0:7482:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1782727881.939221:0:7482:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782727881.939243:0:7482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614cd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614cdc expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.939265:0:7482:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614cd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614cdc expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782727881.939317:0:7482:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782727881.939320:0:7482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782727881.939321:0:7482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782727881.939322:0:7482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782727881.939323:0:7482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782727881.939329:0:7482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782727881.939330:0:7482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782727881.939332:0:7482:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782727881.939333:0:7482:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782727881.939334:0:7482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782727881.939335:0:7482:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782727881.939341:0:7482:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1782727881.939343:0:7482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782727881.939344:0:7482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782727881.939345:0:7482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782727881.939345:0:7482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782727881.939346:0:7482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782727881.939347:0:7482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782727881.939348:0:7482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782727881.939349:0:7482:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782727881.939350:0:7482:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782727881.939351:0:7482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782727881.939351:0:7482:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782727881.939370:0:7482:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1782727881.939384:0:7482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571998720:0@lo:253: 00000100:00100000:2.0:1782727881.939436:0:7482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727881.939458:0:7482:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56df325a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782727881.939594:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571998720 00000100:00100000:0.0:1782727881.939599:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571998720 00000100:00100000:0.0:1782727881.939675:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1782727881.939685:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:7482:x1869325571998720:12345-0@lo:253: 20000000:01000000:0.0:1782727881.939707:0:5801:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1782727881.939723:0:5801:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1782727881.961890:0:5801:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782727881.961947:0:5801:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1782727881.962007:0:5823:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782727881.962014:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782727881.962039:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d56dd3ce400/0x22171c6c29614cf8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.962061:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d56c1667600/0x22171c6c29614c3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614c34 expref: 14 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.962071:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d56dd3ce400/0x22171c6c29614cf8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.962115:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d56c1667600/0x22171c6c29614c3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22171c6c29614c34 expref: 14 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.962131:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d56c1667600/0x22171c6c29614c3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22171c6c29614c34 expref: 14 pid: 5801 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727881.962161:0:5823:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09aad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1869325571998848:0@lo:104: 00000100:00100000:2.0:1782727881.962235:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727881.962323:0:5823:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56df325900 going to sleep for 11 seconds 00000100:00100000:0.0:1782727881.964502:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571998848 00000100:00100000:0.0:1782727881.964548:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571998848 00000100:00100000:0.0:1782727881.964605:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782727881.964615:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+3:5823:x1869325571998848:12345-0@lo:104: 00010000:00010000:0.0:1782727881.964637:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8d56c1667400/0x22171c6c29614c34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614c3b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727881.964737:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782727881.964744:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+3:5823:x1869325571998848:12345-0@lo:104: Request processed in 131us (2510us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727881.964752:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1782727881.964884:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727881.964897:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8d56c1667400/0x22171c6c29614c34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614c3b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.964906:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56c1667400 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:3.0:1782727881.964910:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8d56c1667400/0x22171c6c29614c34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x22171c6c29614c3b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.964919:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8d56c1667400/0x22171c6c29614c34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x22171c6c29614c3b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727881.964927:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8d56c1667400/0x22171c6c29614c34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x22171c6c29614c3b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727881.964933:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727881.964981:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8d56c1667400/0x22171c6c29614c34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614c3b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.964989:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727881.965010:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8d56c1667400/0x22171c6c29614c34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614c3b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.965017:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8d56c1667400/0x22171c6c29614c34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614c3b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.965036:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727881.965038:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727881.965040:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727881.965056:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325571998976:0@lo:103: 00000100:00100000:3.0:1782727881.965097:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727881.965146:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571998976 00000100:00100000:3.0:1782727881.965150:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571998976 00010000:00010000:3.0:1782727881.965178:0:6620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d56c1667600/0x22171c6c29614c3b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614c34 expref: 15 pid: 5801 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727881.965201:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782727881.965208:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0eb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:3316:x1869325571998976:12345-0@lo:103: 00010000:00010000:3.0:1782727881.965219:0:6620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727881.965224:0:6620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d56c1667600/0x22171c6c29614c3b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614c34 expref: 15 pid: 5801 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.965235:0:6620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d56c1667600/0x22171c6c29614c3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22171c6c29614c34 expref: 15 pid: 5801 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.965267:0:6620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d56dd3ce400/0x22171c6c29614cf8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.965278:0:6620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56dd3ce400/0x22171c6c29614cf8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782727881.965295:0:6620:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003282139s 00010000:00010000:3.0:1782727881.965301:0:6620:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d56dd3ce400/0x22171c6c29614cf8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.965308:0:6620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d56dd3ce400/0x22171c6c29614cf8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.965315:0:6620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d56dd3ce400/0x22171c6c29614cf8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.965322:0:6620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d56dd3ce400/0x22171c6c29614cf8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.965328:0:6620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3ce400 already unused, calling callback (ffffffffc152fcf0) 00010000:00010000:3.0:1782727881.965339:0:6620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d56dd3ce400/0x22171c6c29614cf8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.965347:0:6620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d56dd3ce400/0x22171c6c29614cf8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.965356:0:6620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d56dd3ce400/0x22171c6c29614cf8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727881.965367:0:6620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727881.965399:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0eb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:3316:x1869325571998976:12345-0@lo:103: Request processed in 191us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727881.965407:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782727881.965466:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325571998976:0@lo:103: 00010000:00010000:2.0:1782727881.965909:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56c1667600/0x22171c6c29614c3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22171c6c29614c34 expref: 14 pid: 5801 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727881.965920:0:5823:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09aad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1869325571998848:0@lo:104: 00010000:00010000:2.0:1782727881.965934:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d56dd3ce400/0x22171c6c29614cf8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.965943:0:5823:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d56dd3ce400/0x22171c6c29614cf8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.965948:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d56dd3ce400/0x22171c6c29614cf8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727881.965953:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56dd3ce400/0x22171c6c29614cf8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727881.969950:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:7482:x1869325571998720:12345-0@lo:253: Request processed in 30257us (30503us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727881.969981:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1782727881.970088:0:7482:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09a9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7482:1869325571998720:0@lo:253: 10000000:01000000:2.0:1782727881.970104:0:7482:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1782727881.970107:0:7482:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782727881.970109:0:7482:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782727881.970111:0:7482:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782727881.970112:0:7482:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782727881.970113:0:7482:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782727881.970115:0:7482:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782727881.970116:0:7482:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782727881.970118:0:7482:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782727881.970119:0:7482:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782727881.970128:0:7482:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782727881.970129:0:7482:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782727881.970146:0:7482:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1782727881.975410:0:7482:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1782727881.975798:0:7482:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1782727881.976003:0:7482:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1782727881.976153:0:7482:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1782727881.978007:0:7482:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1782727881.978351:0:7482:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1782727881.985704:0:7482:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1782727882.239017:0:7482:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1782727882.239024:0:7482:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1782727882.239063:0:7482:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782727882.239131:0:7482:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.131@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782727882.239147:0:7482:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1782727882.239176:0:7482:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1782727882.733711:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727883.377865:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782727883.377894:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325571999104:0@lo:13: 00000100:00100000:2.0:1782727883.377972:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727883.378085:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571999104 00000100:00100000:0.0:1782727883.378094:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571999104 00000100:00100000:0.0:1782727883.378167:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782727883.378178:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325571999104:12345-0@lo:13: 00002000:00000024:0.0:1782727883.378246:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782727883.378301:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325571999104:12345-0@lo:13: Request processed in 123us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727883.378308:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1782727883.378356:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f5ae3800 x1869325571999104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727883.378378:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325571999104:0@lo:13: 00000100:00080000:2.0:1782727883.379337:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782727883.757712:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727884.782755:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727885.806282:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727886.829658:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727886.958082:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325571999232:0@lo:400: 00000100:00100000:0.0:1782727886.958216:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727886.958790:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571999232 00000100:00100000:3.0:1782727886.958800:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571999232 00000100:00100000:3.0:1782727886.958849:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782727886.958857:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:3314:x1869325571999232:12345-0@lo:400: 00000100:00100000:2.0:1782727886.961951:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869325571999360:0@lo:400: 00000100:00100000:2.0:1782727886.962069:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727886.962105:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782727886.962111:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c3688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869325571999744:0@lo:400: 00000100:00100000:2.0:1782727886.962132:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727886.962162:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c368b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325571999616:0@lo:400: 00000100:00100000:2.0:1782727886.962189:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727886.962238:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782727886.962244:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c3688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869325571999488:0@lo:400: 00000100:00100000:2.0:1782727886.962268:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727886.962380:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:3314:x1869325571999232:12345-0@lo:400: Request processed in 3521us (4162us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727886.962391:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782727886.962424:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571999616 00000100:00100000:3.0:1782727886.962432:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571999616 00000100:00100000:3.0:1782727886.962502:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782727886.962524:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d55c368aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325571999616:12345-0@lo:400: 00000100:00100000:3.0:1782727886.962574:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d55c368aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325571999616:12345-0@lo:400: Request processed in 65us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727886.962580:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782727886.962621:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d55c368b480 x1869325571999616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727886.962635:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c368b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325571999616:0@lo:400: 00000100:00080000:2.0:1782727886.963794:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727886.967883:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325571999232:0@lo:400: 00000100:00100000:0.0:1782727886.967954:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571999360 00000100:00100000:0.0:1782727886.967961:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571999360 00000100:00100000:0.0:1782727886.968023:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571999744 00000100:00100000:0.0:1782727886.968027:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571999744 00000100:00100000:0.0:1782727886.968063:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571999488 00000100:00100000:0.0:1782727886.968066:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571999488 00000100:00100000:0.0:1782727886.968084:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782727886.968102:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d55c368a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869325571999360:12345-0@lo:400: 00000100:00100000:0.0:1782727886.968190:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d55c368a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869325571999360:12345-0@lo:400: Request processed in 89us (6121us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727886.968198:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782727886.968227:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782727886.968234:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d55c3689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869325571999744:12345-0@lo:400: 00000100:00100000:0.0:1782727886.968265:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d55c3689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869325571999744:12345-0@lo:400: Request processed in 32us (6131us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727886.968271:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782727886.968281:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782727886.968288:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d55c3688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869325571999488:12345-0@lo:400: 00000100:00100000:0.0:1782727886.968322:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d55c3688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869325571999488:12345-0@lo:400: Request processed in 35us (6053us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727886.968328:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1782727886.968372:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d55c3688380 x1869325571999744/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727886.968386:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c3688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869325571999744:0@lo:400: 00010000:00080000:0.0:1782727886.968398:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56d09ab100 x1869325571999360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727886.968407:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869325571999360:0@lo:400: 00010000:00080000:0.0:1782727886.968437:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d55c3688a80 x1869325571999488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727886.968447:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c3688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869325571999488:0@lo:400: 00000100:00080000:0.0:1782727886.968462:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782727887.858473:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782727888.111917:0:7837:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1782727888.494751:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782727888.494778:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325571999872:0@lo:13: 00000100:00100000:3.0:1782727888.494848:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727888.494999:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325571999872 00000100:00100000:0.0:1782727888.495007:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325571999872 00000100:00100000:0.0:1782727888.495101:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782727888.495111:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325571999872:12345-0@lo:13: 00002000:00000024:0.0:1782727888.495146:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782727888.495202:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f55e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325571999872:12345-0@lo:13: Request processed in 92us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727888.495209:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1782727888.495252:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:2.0:1782727888.495294:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782727888.495299:0:5803:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8d56c75cf800 from 30 10000000:01000000:2.0:1782727888.495303:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782727888.495329:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cf800/0x22171c6c29614cff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727888.495341:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cf800/0x22171c6c29614cff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727888.495370:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cf800/0x22171c6c29614cff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727888.495384:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c368bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572000000:0@lo:101: 00000100:00100000:2.0:1782727888.495414:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727888.495443:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56ffcc8900 going to sleep for 11 seconds 00000100:00100000:1.0:1782727888.495944:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572000000 00000100:00100000:1.0:1782727888.495950:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572000000 00000100:00100000:1.0:1782727888.495988:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782727888.495995:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:5803:x1869325572000000:12345-0@lo:101: 00010000:00010000:1.0:1782727888.496005:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727888.496017:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56cc3d8400/0x22171c6c29614d06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614cff expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.496036:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56cc3d8400/0x22171c6c29614d06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614cff expref: 14 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.496046:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56cc3d8400/0x22171c6c29614d06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614cff expref: 14 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.496054:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56cc3d8400, rc 0) 00000100:00100000:1.0:1782727888.496089:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:5803:x1869325572000000:12345-0@lo:101: Request processed in 95us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727888.496095:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782727888.496280:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c368bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572000000:0@lo:101: 00010000:00010000:2.0:1782727888.496295:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cf800/0x22171c6c29614cff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614d06 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727888.496305:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cf800/0x22171c6c29614cff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614d06 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727888.496361:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c368bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572000128:0@lo:501: 00000100:00100000:2.0:1782727888.496387:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727888.496934:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56ffcc8900 going to sleep for 11 seconds 00010000:00080000:0.0:1782727888.497101:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f5ae3800 x1869325571999872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727888.497121:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325571999872:0@lo:13: 00000100:00100000:1.0:1782727888.497280:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572000128 00000100:00100000:1.0:1782727888.497297:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572000128 00000100:00100000:1.0:1782727888.497372:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782727888.497381:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:5803:x1869325572000128:12345-0@lo:501: 00000100:00100000:1.0:1782727888.497783:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:5803:x1869325572000128:12345-0@lo:501: Request processed in 403us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727888.497791:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1782727888.497868:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c368bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572000128:0@lo:501: 00000100:00100000:3.0:1782727888.497906:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572000256:0@lo:503: 00000100:00100000:3.0:1782727888.497946:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727888.498336:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c75f43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727888.500635:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572000256 00000100:00100000:2.0:1782727888.500648:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572000256 00000100:00100000:2.0:1782727888.500700:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1782727888.500710:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:5803:x1869325572000256:12345-0@lo:503: 00000100:00100000:2.0:1782727888.501328:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:5803:x1869325572000256:12345-0@lo:503: Request processed in 619us (3380us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727888.501336:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782727888.501633:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572000256:0@lo:503: 00000100:00100000:3.0:1782727888.505048:0:7859:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7859:1869325572000384:0@lo:502: 00000100:00100000:3.0:1782727888.505134:0:7859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727888.505263:0:7859:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c75f46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727888.505350:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572000384 00000100:00100000:2.0:1782727888.505358:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572000384 00000100:00100000:2.0:1782727888.505401:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1782727888.505409:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:7859:x1869325572000384:12345-0@lo:502: 00000100:00100000:2.0:1782727888.505770:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:7859:x1869325572000384:12345-0@lo:502: Request processed in 361us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727888.505778:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1782727888.506805:0:7859:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7859:1869325572000384:0@lo:502: 00000100:00100000:3.0:1782727888.506879:0:7859:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7859:1869325572000512:0@lo:502: 00000100:00100000:3.0:1782727888.506934:0:7859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727888.506975:0:7859:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c75f46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727888.507487:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572000512 00000100:00100000:1.0:1782727888.507496:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572000512 00000100:00100000:1.0:1782727888.507569:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1782727888.507578:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:7859:x1869325572000512:12345-0@lo:502: 00000100:00100000:1.0:1782727888.507806:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:7859:x1869325572000512:12345-0@lo:502: Request processed in 228us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727888.507814:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1782727888.507979:0:7859:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7859:1869325572000512:0@lo:502: 00000040:00080000:3.0:1782727888.508005:0:7859:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1782727888.509098:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1782727888.509128:0:5803:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782727888.509140:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cf800/0x22171c6c29614cff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614d06 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.509152:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cf800/0x22171c6c29614cff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614d06 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727888.509163:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1782727888.509166:0:5803:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1782727888.509168:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1782727888.509214:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9200/0x22171c6c29614d0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.509223:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9200/0x22171c6c29614d0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.509250:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9200/0x22171c6c29614d0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727888.509272:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572000640:0@lo:101: 00000100:00100000:1.0:1782727888.509325:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727888.509364:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c96c2480 going to sleep for 11 seconds 00000100:00100000:1.0:1782727888.509385:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572000640 00000100:00100000:1.0:1782727888.509391:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572000640 00000100:00100000:1.0:1782727888.509436:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1782727888.509444:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:5803:x1869325572000640:12345-0@lo:101: 00010000:00010000:1.0:1782727888.509456:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727888.510330:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56cc3d8800/0x22171c6c29614d14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614d0d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.510362:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56cc3d8800/0x22171c6c29614d14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614d0d expref: 15 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.510372:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56cc3d8800/0x22171c6c29614d14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614d0d expref: 15 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.510380:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56cc3d8800, rc 0) 00000100:00100000:1.0:1782727888.510432:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:5803:x1869325572000640:12345-0@lo:101: Request processed in 989us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727888.510440:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1782727888.510496:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572000640:0@lo:101: 00010000:00010000:1.0:1782727888.510526:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9200/0x22171c6c29614d0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614d14 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.510547:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9200/0x22171c6c29614d0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614d14 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727888.510602:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572000768:0@lo:501: 00000100:00100000:1.0:1782727888.510622:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727888.510640:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c3248cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727888.510650:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572000768 00000100:00100000:1.0:1782727888.510653:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572000768 00000100:00100000:1.0:1782727888.510678:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1782727888.510684:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:5803:x1869325572000768:12345-0@lo:501: 00000100:00100000:1.0:1782727888.510872:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:5803:x1869325572000768:12345-0@lo:501: Request processed in 188us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727888.510877:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1782727888.510897:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572000768:0@lo:501: 00000100:00100000:1.0:1782727888.510915:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572000896:0@lo:503: 00000100:00100000:1.0:1782727888.510941:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727888.510950:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c3248cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727888.510957:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572000896 00000100:00100000:1.0:1782727888.510960:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572000896 00000100:00100000:1.0:1782727888.510974:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1782727888.510978:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:5803:x1869325572000896:12345-0@lo:503: 00000100:00100000:1.0:1782727888.511211:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:5803:x1869325572000896:12345-0@lo:503: Request processed in 230us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727888.511217:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1782727888.511253:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572000896:0@lo:503: 00000100:00100000:1.0:1782727888.511407:0:7860:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7860:1869325572001024:0@lo:502: 00000100:00100000:1.0:1782727888.511430:0:7860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727888.511443:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572001024 00000100:00100000:1.0:1782727888.511446:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572001024 00000100:00100000:1.0:1782727888.511459:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782727888.511463:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:7860:x1869325572001024:12345-0@lo:502: 00000100:00100000:1.0:1782727888.511604:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:7860:x1869325572001024:12345-0@lo:502: Request processed in 139us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727888.511609:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782727888.511633:0:7860:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c3248cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727888.511641:0:7860:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7860:1869325572001024:0@lo:502: 00000020:01000000:1.0:1782727888.511659:0:7860:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782727888.511668:0:7860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727888.511670:0:7860:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782727888.511676:0:7860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782727888.511678:0:7860:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1782727888.511692:0:7860:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7860:1869325572001152:0@lo:502: 00000100:00100000:1.0:1782727888.511718:0:7860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727888.511731:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572001152 00000100:00100000:1.0:1782727888.511734:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572001152 00000100:00100000:1.0:1782727888.511747:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782727888.511750:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:7860:x1869325572001152:12345-0@lo:502: 00000100:00100000:1.0:1782727888.511818:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:7860:x1869325572001152:12345-0@lo:502: Request processed in 67us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727888.511822:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782727888.511843:0:7860:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56df325f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782727888.511851:0:7860:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7860:1869325572001152:0@lo:502: 00000020:01000000:1.0:1782727888.511866:0:7860:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727888.511868:0:7860:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727888.511869:0:7860:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1782727888.511872:0:7860:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1782727888.511907:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1782727888.511918:0:5803:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1782727888.511923:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9200/0x22171c6c29614d0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614d14 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.511929:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9200/0x22171c6c29614d0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614d14 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727888.511936:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782727888.511937:0:5803:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8d56c8fb6000 from 30 10000000:01000000:1.0:1782727888.511939:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782727888.511954:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8e00/0x22171c6c29614d1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.511959:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8e00/0x22171c6c29614d1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.511964:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8e00/0x22171c6c29614d1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727888.511971:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572001280:0@lo:101: 00000100:00100000:1.0:1782727888.511987:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727888.511995:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56df325f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782727888.512002:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572001280 00000100:00100000:1.0:1782727888.512004:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572001280 00000100:00100000:1.0:1782727888.512016:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1782727888.512020:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:5803:x1869325572001280:12345-0@lo:101: 00010000:00010000:1.0:1782727888.512030:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727888.512038:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56cc3d9000/0x22171c6c29614d22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614d1b expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.512051:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56cc3d9000/0x22171c6c29614d22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614d1b expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.512057:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56cc3d9000/0x22171c6c29614d22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614d1b expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.512061:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56cc3d9000, rc 0) 00000100:00100000:1.0:1782727888.512079:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:5803:x1869325572001280:12345-0@lo:101: Request processed in 58us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727888.512082:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1782727888.512101:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572001280:0@lo:101: 00010000:00010000:1.0:1782727888.512107:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8e00/0x22171c6c29614d1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614d22 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.512112:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8e00/0x22171c6c29614d1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614d22 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727888.512134:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572001408:0@lo:501: 00000100:00100000:1.0:1782727888.512154:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727888.512165:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56df325f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782727888.512175:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572001408 00000100:00100000:1.0:1782727888.512178:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572001408 00000100:00100000:1.0:1782727888.512211:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782727888.512217:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:5803:x1869325572001408:12345-0@lo:501: 00000100:00100000:1.0:1782727888.512351:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:5803:x1869325572001408:12345-0@lo:501: Request processed in 134us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727888.512356:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782727888.512376:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572001408:0@lo:501: 00000100:00100000:1.0:1782727888.512391:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572001536:0@lo:503: 00000100:00100000:1.0:1782727888.512412:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727888.512421:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56df325f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782727888.512428:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572001536 00000100:00100000:1.0:1782727888.512430:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572001536 00000100:00100000:1.0:1782727888.512442:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1782727888.512445:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:5803:x1869325572001536:12345-0@lo:503: 00000100:00100000:1.0:1782727888.512566:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:5803:x1869325572001536:12345-0@lo:503: Request processed in 119us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727888.512570:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1782727888.512596:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572001536:0@lo:503: 00000100:00100000:0.0:1782727888.513652:0:7861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7861:1869325572001664:0@lo:502: 00000100:00100000:0.0:1782727888.513703:0:7861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727888.513728:0:7861:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f9830f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782727888.513824:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572001664 00000100:00100000:1.0:1782727888.513828:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572001664 00000100:00100000:1.0:1782727888.513856:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1782727888.513862:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:7861:x1869325572001664:12345-0@lo:502: 00000100:00100000:1.0:1782727888.514047:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:7861:x1869325572001664:12345-0@lo:502: Request processed in 183us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727888.514053:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1782727888.514144:0:7861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7861:1869325572001664:0@lo:502: 00000100:00100000:0.0:1782727888.514199:0:7861:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7861:1869325572001792:0@lo:502: 00000100:00100000:0.0:1782727888.514232:0:7861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727888.514262:0:7861:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f9830f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782727888.514313:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572001792 00000100:00100000:1.0:1782727888.514318:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572001792 00000100:00100000:1.0:1782727888.514347:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1782727888.514354:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:7861:x1869325572001792:12345-0@lo:502: 00000100:00100000:1.0:1782727888.514494:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:7861:x1869325572001792:12345-0@lo:502: Request processed in 140us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727888.514501:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782727888.514890:0:7861:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7861:1869325572001792:0@lo:502: 00000040:00080000:0.0:1782727888.514914:0:7861:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1782727888.515269:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1782727888.515294:0:5803:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782727888.515304:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8e00/0x22171c6c29614d1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614d22 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.515313:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8e00/0x22171c6c29614d1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614d22 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727888.515322:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782727888.515324:0:5803:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8d56c8fb6000 from 5 10000000:01000000:1.0:1782727888.515326:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782727888.515353:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8600/0x22171c6c29614d29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.515361:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8600/0x22171c6c29614d29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.515368:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8600/0x22171c6c29614d29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727888.515383:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572001920:0@lo:101: 00000100:00100000:1.0:1782727888.515417:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727888.515493:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56df325f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782727888.519740:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572001920 00000100:00100000:0.0:1782727888.519757:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572001920 00000100:00100000:0.0:1782727888.519857:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782727888.519869:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:5803:x1869325572001920:12345-0@lo:101: 00010000:00010000:0.0:1782727888.519888:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727888.519910:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56c0031e00/0x22171c6c29614d30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614d29 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727888.519950:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56c0031e00/0x22171c6c29614d30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614d29 expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727888.519962:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56c0031e00/0x22171c6c29614d30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614d29 expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727888.519971:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56c0031e00, rc 0) 00000100:00100000:0.0:1782727888.520055:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:5803:x1869325572001920:12345-0@lo:101: Request processed in 189us (4637us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727888.520062:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782727888.520143:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572001920:0@lo:101: 00010000:00010000:3.0:1782727888.520160:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8600/0x22171c6c29614d29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614d30 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727888.520170:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8600/0x22171c6c29614d29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614d30 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727888.520249:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572002048:0@lo:256: 00000100:00100000:3.0:1782727888.520289:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727888.523263:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c75f46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727888.523342:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572002048 00000100:00100000:1.0:1782727888.523352:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572002048 00000100:00100000:1.0:1782727888.523462:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1782727888.523472:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0877050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:5803:x1869325572002048:12345-0@lo:256: 20000000:01000000:1.0:1782727888.523887:0:5800:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782727888.523910:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782727888.523914:0:5800:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1782727888.524042:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0877050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:5803:x1869325572002048:12345-0@lo:256: Request processed in 570us (3750us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727888.524050:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782727888.524134:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572002048:0@lo:256: 10000000:01000000:3.0:1782727888.524187:0:5803:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782727888.524206:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8600/0x22171c6c29614d29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614d30 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727888.524217:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8600/0x22171c6c29614d29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614d30 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727888.524226:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1782727888.524229:0:5803:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1782727888.524232:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782727888.524260:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d57021c0600/0x22171c6c29614d37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727888.524268:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d57021c0600/0x22171c6c29614d37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727888.524286:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d57021c0600/0x22171c6c29614d37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727888.524306:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572002176:0@lo:101: 00000100:00100000:3.0:1782727888.524340:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727888.524374:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c75f46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727888.524452:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572002176 00000100:00100000:1.0:1782727888.524457:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572002176 00000100:00100000:1.0:1782727888.524479:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1782727888.524486:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0875c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:5803:x1869325572002176:12345-0@lo:101: 00010000:00010000:1.0:1782727888.524494:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727888.524818:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56f94b1200/0x22171c6c29614d3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614d37 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.524843:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56f94b1200/0x22171c6c29614d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614d37 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.524853:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56f94b1200/0x22171c6c29614d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614d37 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.524861:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f94b1200, rc 0) 00000100:00100000:1.0:1782727888.524937:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0875c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:5803:x1869325572002176:12345-0@lo:101: Request processed in 451us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727888.524943:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782727888.525081:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572002176:0@lo:101: 00010000:00010000:3.0:1782727888.525093:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d57021c0600/0x22171c6c29614d37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614d3e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727888.525102:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d57021c0600/0x22171c6c29614d37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614d3e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727888.525150:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572002304:0@lo:501: 00000100:00100000:3.0:1782727888.525176:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727888.525210:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c75f46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727888.525250:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572002304 00000100:00100000:1.0:1782727888.525254:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572002304 00000100:00100000:1.0:1782727888.525309:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1782727888.525316:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0876050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:5803:x1869325572002304:12345-0@lo:501: 00000100:00100000:1.0:1782727888.525590:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0876050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:5803:x1869325572002304:12345-0@lo:501: Request processed in 274us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727888.525603:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1782727888.525672:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572002304:0@lo:501: 00000100:00100000:3.0:1782727888.525703:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572002432:0@lo:503: 00000100:00100000:3.0:1782727888.525739:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727888.525879:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c75f46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727888.525914:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572002432 00000100:00100000:2.0:1782727888.525919:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572002432 00000100:00100000:2.0:1782727888.525942:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1782727888.525950:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:5803:x1869325572002432:12345-0@lo:503: 00000100:00100000:2.0:1782727888.526256:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:5803:x1869325572002432:12345-0@lo:503: Request processed in 306us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727888.526263:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782727888.526381:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572002432:0@lo:503: 00000100:00100000:3.0:1782727888.526775:0:7863:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7863:1869325572002560:0@lo:502: 00000100:00100000:3.0:1782727888.526815:0:7863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727888.526838:0:7863:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c75f4780 going to sleep for 11 seconds 00000100:00100000:2.0:1782727888.526880:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572002560 00000100:00100000:2.0:1782727888.526884:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572002560 00000100:00100000:2.0:1782727888.528243:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1782727888.528259:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:7863:x1869325572002560:12345-0@lo:502: 00000100:00100000:2.0:1782727888.528613:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:7863:x1869325572002560:12345-0@lo:502: Request processed in 359us (1796us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727888.528621:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782727888.528838:0:7863:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7863:1869325572002560:0@lo:502: 00000020:01000000:3.0:1782727888.528877:0:7863:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782727888.528890:0:7863:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1782727888.528897:0:7863:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727888.528899:0:7863:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1782727888.528903:0:7863:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1782727888.528907:0:7863:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.131@tcp to nid 0x20000c0a8ca83 (192.168.202.131@tcp) 00000020:01000000:3.0:1782727888.528930:0:7863:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1782727888.528933:0:7863:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782727888.528947:0:7863:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d56ffb24d70) 00000020:00000080:3.0:1782727888.528967:0:7863:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1782727888.528973:0:7863:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1782727888.529062:0:7863:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1782727888.529069:0:7863:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1782727888.529076:0:7863:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x22171c6c29614d4c 00010000:00080000:3.0:1782727888.529105:0:7863:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d56c7549000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.131@tcp at head 00010000:00010000:3.0:1782727888.529337:0:7863:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1782727888.529671:0:7863:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1782727888.529683:0:7863:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1782727888.531962:0:7863:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782727888.533809:0:7863:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782727888.533911:0:7863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1782727888.533999:0:7863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1782727888.536385:0:7864:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782727888.536399:0:7864:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1782727888.543143:0:7863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782727888.543161:0:7863:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1782727888.543215:0:7863:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1782727888.543239:0:7863:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22171c6c29614d53 00000100:00080000:1.0:1782727888.543251:0:7863:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782727888.543258:0:7863:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d56c7549000 using connection 192.168.202.131@tcp/0@lo 00000100:00100000:1.0:1782727888.543296:0:7863:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d56f59e5500 x1869325572002688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782727888.543323:0:7863:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1782727888.543405:0:7863:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727888.543410:0:7863:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727888.543412:0:7863:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1782727888.543419:0:7863:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782727888.543423:0:7863:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727888.543425:0:7863:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782727888.543428:0:7863:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782727888.543429:0:7863:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1782727888.543463:0:7863:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7863:1869325572002816:0@lo:502: 00000100:00100000:1.0:1782727888.543573:0:7863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727888.543610:0:7863:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c3248d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782727888.543714:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869325572002688:0@lo:8: 00000100:00100000:0.0:1782727888.543894:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727888.543930:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782727888.543951:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572002816 00000100:00100000:3.0:1782727888.543953:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869325572003200:0@lo:400: 00000100:00100000:0.0:1782727888.543959:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572002816 00000100:00100000:0.0:1782727888.544016:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1782727888.544027:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727888.544031:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0874c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:7863:x1869325572002816:12345-0@lo:502: 00000100:00100000:3.0:1782727888.544083:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572003200 00000100:00100000:3.0:1782727888.544091:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572003200 00000100:00100000:0.0:1782727888.544300:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0874c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:7863:x1869325572002816:12345-0@lo:502: Request processed in 273us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727888.544308:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1782727888.544354:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869325572003072:0@lo:400: 00000100:00100000:0.0:1782727888.544382:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727888.544409:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727888.544418:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869325572002944:0@lo:400: 00000100:00100000:3.0:1782727888.544439:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572003072 00000100:00100000:0.0:1782727888.544444:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727888.544457:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572003072 00000100:00100000:0.0:1782727888.544488:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572002688 00000100:00100000:0.0:1782727888.544495:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572002688 00000100:00100000:0.0:1782727888.544556:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782727888.544561:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3313:x1869325572002688:12345-0@lo:8: 00010000:00080000:0.0:1782727888.544583:0:6607:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:0.0:1782727888.544609:0:6607:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x22171c6c29614d5a 00002000:00100000:0.0:1782727888.544622:0:6607:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d5700dc0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1782727888.544626:0:6607:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1782727888.544630:0:6607:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1782727888.544674:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572002944 00000100:00100000:3.0:1782727888.544681:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572002944 00000100:00100000:3.0:1782727888.544712:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782727888.544722:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869325572003200:12345-0@lo:400: 00000100:00100000:3.0:1782727888.544788:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f55e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869325572003200:12345-0@lo:400: Request processed in 68us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727888.544796:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782727888.544811:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782727888.544817:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869325572003072:12345-0@lo:400: 00000100:00100000:3.0:1782727888.544851:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869325572003072:12345-0@lo:400: Request processed in 34us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727888.544858:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782727888.544879:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782727888.544886:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869325572002944:12345-0@lo:400: 00002000:00100000:0.0:1782727888.544900:0:6607:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1782727888.544922:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869325572002944:12345-0@lo:400: Request processed in 35us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727888.544929:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1782727888.544955:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782727888.545006:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f55e3b80 x1869325572003200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727888.545024:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869325572003200:0@lo:400: 00010000:00080000:3.0:1782727888.545070:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f55e0380 x1869325572002944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727888.545082:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869325572002944:0@lo:400: 00010000:00080000:3.0:1782727888.545103:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f55e2a00 x1869325572003072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1782727888.545121:0:6607:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782727888.545149:0:6607:0:(import.c:65:import_set_state_nolock()) ffff8d5700dc6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782727888.545216:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1869325572002688:12345-0@lo:8: Request processed in 652us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727888.545223:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782727888.545262:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869325572003072:0@lo:400: 00010000:00080000:0.0:1782727888.545293:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f59e5500 x1869325572002688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782727898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727888.545305:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782727888.545312:0:3313:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00100000:1.0:1782727888.545890:0:7863:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:7863:1869325572002816:0@lo:502: 00000020:01000000:1.0:1782727888.545931:0:7863:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727888.545940:0:7863:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727888.545942:0:7863:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1782727888.545947:0:7863:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1782727888.546321:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1782727888.546340:0:5803:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782727888.546350:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d57021c0600/0x22171c6c29614d37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614d3e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727888.546360:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d57021c0600/0x22171c6c29614d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614d3e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727888.546369:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1782727888.546371:0:5803:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8d56d0964d70 from 1 10000000:01000000:3.0:1782727888.546374:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782727888.546403:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d57021c1000/0x22171c6c29614d61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727888.546410:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d57021c1000/0x22171c6c29614d61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727888.546419:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d57021c1000/0x22171c6c29614d61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727888.546438:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572003328:0@lo:101: 00000100:00100000:3.0:1782727888.546489:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782727888.547897:0:3313:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1782727888.547908:0:3313:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1782727888.547912:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8d56c7549000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1782727888.547935:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1782727888.547946:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1869325572002688:0@lo:8: 00000100:00100000:3.0:1782727888.548465:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c75f43c0 going to sleep for 11 seconds 00000004:00080000:3.0:1782727888.548483:0:7864:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1782727888.548650:0:7864:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 212502140215ns, next at 0ns, rc = 0 00000100:00100000:1.0:1782727888.548863:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572003328 00000100:00100000:1.0:1782727888.548871:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572003328 00000100:00100000:1.0:1782727888.548920:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1782727888.548930:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0874850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:5803:x1869325572003328:12345-0@lo:101: 00010000:00010000:1.0:1782727888.548945:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727888.548965:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56f94b0e00/0x22171c6c29614d68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614d61 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.548990:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56f94b0e00/0x22171c6c29614d68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614d61 expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.549000:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56f94b0e00/0x22171c6c29614d68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614d61 expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727888.549008:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f94b0e00, rc 0) 00000100:00100000:1.0:1782727888.549066:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0874850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:5803:x1869325572003328:12345-0@lo:101: Request processed in 138us (2576us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727888.549073:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782727888.557057:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572003328:0@lo:101: 00010000:00010000:3.0:1782727888.557084:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d57021c1000/0x22171c6c29614d61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614d68 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727888.557106:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d57021c1000/0x22171c6c29614d61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614d68 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727888.557197:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572003456:0@lo:501: 00000100:00100000:3.0:1782727888.557259:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727888.557305:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c75f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727888.557429:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572003456 00000100:00100000:0.0:1782727888.557436:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572003456 00000100:00100000:0.0:1782727888.557486:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782727888.557494:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:5803:x1869325572003456:12345-0@lo:501: 00000100:00100000:0.0:1782727888.560052:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:5803:x1869325572003456:12345-0@lo:501: Request processed in 2549us (2784us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782727888.560067:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1782727888.560662:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572003456:0@lo:501: 10000000:01000000:3.0:1782727888.560703:0:5803:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782727888.560713:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d57021c1000/0x22171c6c29614d61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614d68 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727888.560724:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d57021c1000/0x22171c6c29614d61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614d68 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782727888.638091:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1782727888.726914:0:7865:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1782727888.726948:0:7865:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c368a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7865:1869325572003712:0@lo:7: 00000100:00100000:2.0:1782727888.727021:0:7865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727888.727073:0:7865:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f9818240 going to sleep for 11 seconds 00000100:00100000:2.0:1782727888.727087:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727888.727100:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c3689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572003584:0@lo:13: 00000100:00100000:2.0:1782727888.727126:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727888.727158:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572003712 00000100:00100000:2.0:1782727888.727165:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572003712 00000100:00100000:2.0:1782727888.727237:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782727888.727262:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d55c3689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7865:x1869325572003712:12345-0@lo:7: 00000100:00080000:3.0:1782727888.731024:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727888.731051:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572003584 00000100:00100000:3.0:1782727888.731060:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572003584 00000100:00100000:3.0:1782727888.731119:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782727888.731128:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d55c3688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1869325572003584:12345-0@lo:13: 00002000:00000024:3.0:1782727888.731162:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1782727888.731265:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d55c3688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1869325572003584:12345-0@lo:13: Request processed in 138us (4137us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727888.731273:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1782727888.738565:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d55c3689180 x1869325572003584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727888.738593:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c3689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572003584:0@lo:13: 00002000:00080000:2.0:1782727888.741640:0:6604:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1782727888.741648:0:6604:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1782727888.741741:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d55c3689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7865:x1869325572003712:12345-0@lo:7: Request processed in 14477us (14716us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727888.741751:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1782727888.741961:0:7865:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d55c368a300 x1869325572003712/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782727904 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727888.741978:0:7865:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c368a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7865:1869325572003712:0@lo:7: 00000004:00080000:1.0:1782727888.741991:0:7865:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1782727888.742026:0:7865:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7865:1869325572003840:0@lo:5: 00000100:00100000:1.0:1782727888.742057:0:7865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727888.742105:0:7865:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c97839c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727888.742152:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572003840 00000100:00100000:3.0:1782727888.742158:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572003840 00000100:00100000:3.0:1782727888.742212:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782727888.742221:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7865:x1869325572003840:12345-0@lo:5: 00002000:00080000:3.0:1782727888.742254:0:6606:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1782727888.742257:0:6606:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1782727888.742470:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7865:x1869325572003840:12345-0@lo:5: Request processed in 250us (411us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1782727888.742488:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1782727888.742693:0:7865:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f59e4a80 x1869325572003840/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782727904 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727888.742705:0:7865:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7865:1869325572003840:0@lo:5: 00000004:00080000:1.0:1782727888.742723:0:7865:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1782727888.742747:0:7865:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7865:1869325572003968:0@lo:700: 00000100:00100000:1.0:1782727888.742770:0:7865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727888.742793:0:7865:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c97839c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727888.743111:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572003968 00000100:00100000:3.0:1782727888.743115:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572003968 00000100:00100000:3.0:1782727888.743154:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782727888.743161:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7865:x1869325572003968:12345-0@lo:700: 00000100:00100000:3.0:1782727888.743195:0:6613:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6613:1869325572004096:0@lo:700: 00000100:00100000:3.0:1782727888.743223:0:6613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727888.743244:0:6613:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c75f4300 going to sleep for 11 seconds 00000100:00100000:1.0:1782727888.743325:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572004096 00000100:00100000:1.0:1782727888.743329:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572004096 00000100:00100000:1.0:1782727888.743360:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782727888.743365:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6613:x1869325572004096:12345-0@lo:700: 40000000:02000000:1.0:1782727888.771676:0:5813:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1782727888.776994:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f55e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6613:x1869325572004096:12345-0@lo:700: Request processed in 33617us (33758us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727888.777015:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782727888.777104:0:6613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f55e2a00 x1869325572004096/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782727904 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727888.777120:0:6613:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6613:1869325572004096:0@lo:700: 40000000:02000000:3.0:1782727888.777214:0:6613:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:0.0:1782727888.880751:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782727888.917336:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1782727888.917361:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1782727888.917658:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7865:x1869325572003968:12345-0@lo:700: Request processed in 174491us (174880us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727888.917672:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782727888.917767:0:7865:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f59e4e00 x1869325572003968/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782727904 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727888.917779:0:7865:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1782727888.917796:0:7865:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7865:1869325572003968:0@lo:700: 00000004:02000040:1.0:1782727889.004357:0:7865:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1782727889.009945:0:7865:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7865:1869325572004224:0@lo:5: 00000100:00100000:0.0:1782727889.010017:0:7865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727889.010072:0:7865:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d0f52780 going to sleep for 11 seconds 00000100:00100000:2.0:1782727889.012310:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572004224 00000100:00100000:2.0:1782727889.012324:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572004224 00000100:00100000:2.0:1782727889.012397:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782727889.012406:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7865:x1869325572004224:12345-0@lo:5: 00002000:00080000:2.0:1782727889.032831:0:6604:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1782727889.032856:0:6604:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1782727889.044412:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7865:x1869325572004224:12345-0@lo:5: Request processed in 32000us (34388us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1782727889.044425:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1782727889.044726:0:7865:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f5ae0700 x1869325572004224/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782727905 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727889.044745:0:7865:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7865:1869325572004224:0@lo:5: 00000004:00080000:1.0:1782727889.044761:0:7865:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1782727889.901974:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727890.926262:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727891.953863:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782727892.314006:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1782727892.976163:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727893.613731:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782727893.613764:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572004352:0@lo:13: 00000100:00100000:3.0:1782727893.613844:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727893.613897:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572004352 00000100:00100000:0.0:1782727893.613908:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572004352 00000100:00080000:3.0:1782727893.613944:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727893.613990:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782727893.614003:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572004352:12345-0@lo:13: 00000100:00100000:1.0:1782727893.614006:0:6609:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1782727893.614019:0:6609:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1782727893.614052:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782727893.614120:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f55e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572004352:12345-0@lo:13: Request processed in 120us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727893.614128:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1782727893.614205:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f55e2a00 x1869325572004352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727893.614229:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572004352:0@lo:13: 00000100:00100000:0.0:1782727893.615454:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c368b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869325572004864:0@lo:400: 00000100:00100000:2.0:1782727893.615461:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c3689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869325572004608:0@lo:400: 00000100:00100000:3.0:1782727893.615530:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c3689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3317:1869325572004480:0@lo:400: 00000100:00100000:1.0:1782727893.615630:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c368b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869325572004736:0@lo:400: 00000100:00100000:0.0:1782727893.616199:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727893.616226:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572004864 00000100:00100000:2.0:1782727893.616234:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572004864 00000100:00100000:0.0:1782727893.616251:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727893.616288:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572004608 00000100:00100000:0.0:1782727893.616292:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572004608 00000100:00100000:2.0:1782727893.616301:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782727893.616310:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869325572004864:12345-0@lo:400: 00000100:00100000:0.0:1782727893.616314:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782727893.616319:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869325572004608:12345-0@lo:400: 00000100:00100000:2.0:1782727893.616363:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869325572004864:12345-0@lo:400: Request processed in 54us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727893.616363:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869325572004608:12345-0@lo:400: Request processed in 42us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727893.616371:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782727893.616378:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1782727893.616402:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782727893.616422:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d55c3689f80 x1869325572004608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727893.616438:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c3689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869325572004608:0@lo:400: 00000100:00100000:3.0:1782727893.616460:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1782727893.616469:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d55c368b800 x1869325572004864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727893.616478:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c368b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869325572004864:0@lo:400: 00000100:00100000:3.0:1782727893.616561:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c3688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572004992:0@lo:400: 00000100:00100000:3.0:1782727893.616595:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727893.616635:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572004992 00000100:00100000:0.0:1782727893.616640:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572004992 00000100:00100000:2.0:1782727893.616669:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572004480 00000100:00100000:2.0:1782727893.616673:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572004480 00000100:00100000:0.0:1782727893.616681:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782727893.616687:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572004992:12345-0@lo:400: 00000100:00100000:2.0:1782727893.616696:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1782727893.616702:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0874050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3317:x1869325572004480:12345-0@lo:400: 00000100:00100000:0.0:1782727893.616722:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f55e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572004992:12345-0@lo:400: Request processed in 35us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727893.616728:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0874050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3317:x1869325572004480:12345-0@lo:400: Request processed in 27us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727893.616729:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782727893.616734:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1782727893.616793:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727893.616806:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c3689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3317:1869325572004480:0@lo:400: 00010000:00080000:3.0:1782727893.616813:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d55c3688700 x1869325572004992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727893.616818:0:3317:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1782727893.616827:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c3688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572004992:0@lo:400: 00000100:00100000:1.0:1782727893.619756:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727893.619888:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572004736 00000100:00100000:3.0:1782727893.619897:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572004736 00000100:00080000:0.0:1782727893.619955:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727893.619963:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782727893.619972:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869325572004736:12345-0@lo:400: 00000100:00100000:3.0:1782727893.620052:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869325572004736:12345-0@lo:400: Request processed in 80us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727893.620059:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1782727893.620102:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d55c368b100 x1869325572004736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782727909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727893.620116:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c368b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869325572004736:0@lo:400: 00000100:00100000:0.0:1782727893.790121:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727893.791743:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552058752 00000100:00100000:2.0:1782727893.791762:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552058752 00000100:00100000:2.0:1782727893.791848:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 112 00000100:00100000:2.0:1782727893.791861:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0874450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2351:x1869325552058752:12345-192.168.202.31@tcp:250: 00010000:00080000:2.0:1782727893.791909:0:5798:0:(ldlm_lib.c:1434:target_handle_connect()) MGS: connection from b661aafc-708f-4f38-b71b-eec242d406b4@192.168.202.31@tcp t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:2.0:1782727893.791945:0:5798:0:(genops.c:1406:class_connect()) connect: client b661aafc-708f-4f38-b71b-eec242d406b4, cookie 0x22171c6c29614d6f 00000100:00080000:2.0:1782727893.792136:0:5798:0:(import.c:65:import_set_state_nolock()) ffff8d56f9365000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782727893.792235:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0874450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+5:2351:x1869325552058752:12345-192.168.202.31@tcp:250: Request processed in 375us (2127us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727893.792244:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 112 00000100:00100000:1.0:1782727893.797988:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727893.798069:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552058624 00000100:00100000:2.0:1782727893.798082:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552058624 00000100:00100000:2.0:1782727893.798170:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 113 00000100:00100000:2.0:1782727893.798183:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+5:5554:x1869325552058624:12345-192.168.202.31@tcp:101: 00010000:00010000:2.0:1782727893.798223:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727893.798249:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56dd3cec00/0x22171c6c29614d76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x44e8af495f209bf expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727893.798291:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56dd3cec00/0x22171c6c29614d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f209bf expref: 6 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727893.798305:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56dd3cec00/0x22171c6c29614d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f209bf expref: 6 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727893.798318:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3cec00, rc 0) 00000100:00100000:2.0:1782727893.798405:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+6:5554:x1869325552058624:12345-192.168.202.31@tcp:101: Request processed in 224us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727893.798413:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 113 00000100:00100000:0.0:1782727893.800902:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727893.801027:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552058880 00000100:00100000:2.0:1782727893.801039:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552058880 00000100:00100000:2.0:1782727893.801110:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 114 00000100:00100000:2.0:1782727893.801122:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0875850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+6:5554:x1869325552058880:12345-192.168.202.31@tcp:501: 00000100:00100000:2.0:1782727893.801703:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0875850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+6:5554:x1869325552058880:12345-192.168.202.31@tcp:501: Request processed in 580us (810us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782727893.801713:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 114 00000100:00100000:1.0:1782727893.806262:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782727893.806354:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552059008 00000100:00100000:0.0:1782727893.806366:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552059008 00000100:00100000:0.0:1782727893.806459:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 115 00000100:00100000:0.0:1782727893.806471:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0875450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+6:5554:x1869325552059008:12345-192.168.202.31@tcp:101: 00010000:00010000:0.0:1782727893.806493:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727893.806570:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56c0031400/0x22171c6c29614d7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x44e8af495f209c6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727893.806610:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56c0031400/0x22171c6c29614d7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f209c6 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727893.806928:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56c0031400/0x22171c6c29614d7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f209c6 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727893.806939:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56c0031400, rc 0) 00000100:00100000:0.0:1782727893.807023:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0875450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+7:5554:x1869325552059008:12345-192.168.202.31@tcp:101: Request processed in 554us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727893.807032:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 115 00000100:00100000:1.0:1782727893.810616:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782727893.810768:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552059136 00000100:00100000:0.0:1782727893.810781:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552059136 00000100:00100000:0.0:1782727893.810865:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 116 00000100:00100000:0.0:1782727893.810878:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+7:5554:x1869325552059136:12345-192.168.202.31@tcp:501: 00000100:00100000:0.0:1782727893.811311:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+8:5554:x1869325552059136:12345-192.168.202.31@tcp:501: Request processed in 434us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727893.811321:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 116 00000100:00100000:2.0:1782727893.816880:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782727893.816999:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552059264 00000100:00100000:0.0:1782727893.817014:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552059264 00000100:00100000:0.0:1782727893.817124:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 117 00000100:00100000:0.0:1782727893.817137:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0876450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+8:5554:x1869325552059264:12345-192.168.202.31@tcp:503: 00000100:00100000:0.0:1782727893.817700:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0876450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+8:5554:x1869325552059264:12345-192.168.202.31@tcp:503: Request processed in 556us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727893.817712:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 117 00000100:00100000:1.0:1782727893.837205:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727893.837326:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552059392 00000100:00100000:2.0:1782727893.837338:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552059392 00000100:00100000:2.0:1782727893.837418:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 118 00000100:00100000:2.0:1782727893.837429:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0875050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+8:5572:x1869325552059392:12345-192.168.202.31@tcp:502: 00000100:00100000:2.0:1782727893.837918:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0875050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+8:5572:x1869325552059392:12345-192.168.202.31@tcp:502: Request processed in 485us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727893.837934:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 118 00000100:00100000:1.0:1782727893.865884:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782727893.866588:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552059520 00000100:00100000:0.0:1782727893.866602:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552059520 00000100:00100000:1.0:1782727893.866849:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 119 00000100:00100000:1.0:1782727893.866861:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+8:5572:x1869325552059520:12345-192.168.202.31@tcp:502: 00000100:00100000:1.0:1782727893.867235:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+8:5572:x1869325552059520:12345-192.168.202.31@tcp:502: Request processed in 376us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727893.867244:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 119 00000100:00100000:3.0:1782727893.869413:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727893.874220:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552059648 00000100:00100000:2.0:1782727893.874240:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552059648 00000100:00100000:2.0:1782727893.874317:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 120 00000100:00100000:2.0:1782727893.874329:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+8:5554:x1869325552059648:12345-192.168.202.31@tcp:101: 00010000:00010000:2.0:1782727893.874352:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727893.874376:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56dd3ce200/0x22171c6c29614d84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44e8af495f209f0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727893.874414:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56dd3ce200/0x22171c6c29614d84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f209f0 expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727893.874427:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56dd3ce200/0x22171c6c29614d84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f209f0 expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727893.874438:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3ce200, rc 0) 00000100:00100000:2.0:1782727893.874546:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+9:5554:x1869325552059648:12345-192.168.202.31@tcp:101: Request processed in 219us (5145us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727893.874567:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 120 00000100:00100000:0.0:1782727893.885052:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727893.885676:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552059776 00000100:00100000:2.0:1782727893.885690:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552059776 00000100:00100000:2.0:1782727893.885765:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 121 00000100:00100000:2.0:1782727893.885778:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+9:5554:x1869325552059776:12345-192.168.202.31@tcp:256: 20000000:01000000:2.0:1782727893.885815:0:5800:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1782727893.885845:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1782727893.885850:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1782727893.885854:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1782727893.885863:0:5800:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1782727893.887080:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+9:5554:x1869325552059776:12345-192.168.202.31@tcp:256: Request processed in 1298us (2044us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727893.887093:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 121 00000100:00100000:3.0:1782727893.890134:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727893.891401:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552059904 00000100:00100000:1.0:1782727893.891422:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552059904 00000100:00100000:1.0:1782727893.891502:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 122 00000100:00100000:1.0:1782727893.891545:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+9:5554:x1869325552059904:12345-192.168.202.31@tcp:101: 00010000:00010000:1.0:1782727893.891568:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727893.891590:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56f94b0a00/0x22171c6c29614d8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x44e8af495f209f7 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727893.891631:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56f94b0a00/0x22171c6c29614d8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f209f7 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727893.891645:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56f94b0a00/0x22171c6c29614d8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f209f7 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727893.891656:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f94b0a00, rc 0) 00000100:00100000:1.0:1782727893.891764:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+10:5554:x1869325552059904:12345-192.168.202.31@tcp:101: Request processed in 252us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727893.891772:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 122 00000100:00100000:0.0:1782727893.896964:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727893.907695:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552060032 00000100:00100000:2.0:1782727893.907716:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552060032 00000100:00100000:2.0:1782727893.907809:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 123 00000100:00100000:2.0:1782727893.907820:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:5554:x1869325552060032:12345-192.168.202.31@tcp:501: 00000100:00100000:2.0:1782727893.908262:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:5554:x1869325552060032:12345-192.168.202.31@tcp:501: Request processed in 442us (11383us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727893.908271:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 123 00000100:00100000:2.0:1782727893.912041:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782727893.913136:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552060160 00000100:00100000:0.0:1782727893.913178:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552060160 00000100:00100000:0.0:1782727893.913264:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 124 00000100:00100000:0.0:1782727893.913277:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+10:5554:x1869325552060160:12345-192.168.202.31@tcp:503: 00000100:00100000:0.0:1782727893.913768:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+10:5554:x1869325552060160:12345-192.168.202.31@tcp:503: Request processed in 492us (1739us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727893.913777:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 124 00000100:00100000:3.0:1782727893.916225:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727893.916319:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552060288 00000100:00100000:1.0:1782727893.916332:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552060288 00000100:00100000:1.0:1782727893.916400:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 125 00000100:00100000:1.0:1782727893.916411:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+10:5577:x1869325552060288:12345-192.168.202.31@tcp:502: 00000100:00100000:1.0:1782727893.916786:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+10:5577:x1869325552060288:12345-192.168.202.31@tcp:502: Request processed in 375us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727893.916794:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 125 00000100:00100000:2.0:1782727893.918643:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727893.919343:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552060416 00000100:00100000:1.0:1782727893.919355:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552060416 00000100:00100000:1.0:1782727893.919977:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 126 00000100:00100000:1.0:1782727893.919993:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:5577:x1869325552060416:12345-192.168.202.31@tcp:502: 00000100:00100000:1.0:1782727893.920348:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:5577:x1869325552060416:12345-192.168.202.31@tcp:502: Request processed in 359us (1726us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727893.920357:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 126 00000100:00100000:2.0:1782727893.923118:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782727893.923321:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552060544 00000100:00100000:0.0:1782727893.923333:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552060544 00000100:00100000:0.0:1782727893.923402:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4 00000100:00100000:0.0:1782727893.923412:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d55c368ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2351:x1869325552060544:12345-192.168.202.31@tcp:38: 00010000:00080000:0.0:1782727893.923460:0:5806:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-MDT0000: connection from f9926b93-a1e5-4dad-ade1-7cd7c966fac6@192.168.202.31@tcp t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:0.0:1782727893.923563:0:5806:0:(genops.c:1406:class_connect()) connect: client f9926b93-a1e5-4dad-ade1-7cd7c966fac6, cookie 0x22171c6c29614d92 00000004:00100000:0.0:1782727893.923608:0:5806:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1782727893.923617:0:5806:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1782727893.985317:0:5806:0:(import.c:65:import_set_state_nolock()) ffff8d56ffb73800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782727893.985424:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d55c368ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2351:x1869325552060544:12345-192.168.202.31@tcp:38: Request processed in 62007us (62323us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727893.985438:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4 00010000:00010000:0.0:1782727894.002734:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727894.125832:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572005120:0@lo:13: 00000100:00100000:0.0:1782727894.125935:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727894.126281:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572005120 00000100:00100000:3.0:1782727894.126292:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572005120 00000100:00100000:3.0:1782727894.126900:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782727894.126914:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572005120:12345-0@lo:13: 00002000:00000024:3.0:1782727894.126961:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782727894.127416:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572005120:12345-0@lo:13: Request processed in 504us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727894.127427:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1782727894.127682:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f59e4a80 x1869325572005120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727894.127707:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572005120:0@lo:13: 00000100:00100000:3.0:1782727894.992325:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727894.992384:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727894.992586:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552060672 00000100:00100000:1.0:1782727894.992600:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552060672 00000100:00080000:0.0:1782727894.992693:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727894.992778:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552060800 00000100:00100000:1.0:1782727894.992782:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552060800 00000100:00100000:1.0:1782727894.993231:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5 00000100:00100000:1.0:1782727894.993268:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:0:x1869325552060672:12345-192.168.202.31@tcp:41: 00000004:00000024:1.0:1782727894.993356:0:5808:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1782727894.993406:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 6 00000100:00100000:1.0:1782727894.993488:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f55e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:0:x1869325552060672:12345-192.168.202.31@tcp:41: Request processed in 246us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727894.993655:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:5554:x1869325552060800:12345-192.168.202.31@tcp:41: 00000004:00000024:0.0:1782727894.993676:0:5807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1782727894.994147:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f55e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:5554:x1869325552060800:12345-192.168.202.31@tcp:41: Request processed in 690us (1751us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727894.994702:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5 00000100:00100000:0.0:1782727894.996921:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 6 00000100:00100000:3.0:1782727895.000979:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727895.001172:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552060928 00000100:00100000:2.0:1782727895.001186:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552060928 00000100:00100000:2.0:1782727895.001259:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 7 00000100:00100000:2.0:1782727895.001270:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:5554:x1869325552060928:12345-192.168.202.31@tcp:40: 00000100:00100000:2.0:1782727895.001666:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f55e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:5554:x1869325552060928:12345-192.168.202.31@tcp:40: Request processed in 395us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727895.001677:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 7 00000100:00100000:2.0:1782727895.004726:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727895.006981:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727895.007029:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727895.007164:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552061312 00000100:00100000:2.0:1782727895.007178:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552061312 00000100:00100000:2.0:1782727895.007241:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 127 00000100:00100000:2.0:1782727895.007253:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+10:2353:x1869325552061312:12345-192.168.202.31@tcp:400: 00000100:00100000:2.0:1782727895.007359:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+10:2353:x1869325552061312:12345-192.168.202.31@tcp:400: Request processed in 108us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727895.007383:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 127 00000100:00100000:3.0:1782727895.009020:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727895.009185:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552061440 00000100:00100000:2.0:1782727895.009198:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552061440 00000100:00100000:0.0:1782727895.009198:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552061056 00000100:00100000:0.0:1782727895.009203:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552061056 00000100:00100000:2.0:1782727895.009242:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 0 00000100:00100000:0.0:1782727895.009244:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552061184 00000100:00100000:0.0:1782727895.009246:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552061184 00000100:00100000:2.0:1782727895.009251:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:5554:x1869325552061440:12345-192.168.202.31@tcp:33: 00000100:00100000:0.0:1782727895.009258:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 8 00000100:00100000:0.0:1782727895.009263:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d55c3689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1869325552061056:12345-192.168.202.31@tcp:8: 00010000:00080000:0.0:1782727895.009295:0:6604:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0000: connection from f9926b93-a1e5-4dad-ade1-7cd7c966fac6@192.168.202.31@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:0.0:1782727895.009357:0:6604:0:(genops.c:1406:class_connect()) connect: client f9926b93-a1e5-4dad-ade1-7cd7c966fac6, cookie 0x22171c6c29614d99 00002000:00100000:0.0:1782727895.009373:0:6604:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f9926b93-a1e5-4dad-ade1-7cd7c966fac6/ffff8d56c7563800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782727895.009390:0:6604:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782727895.009869:0:6604:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782727895.010045:0:6604:0:(import.c:65:import_set_state_nolock()) ffff8d56c7560800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782727895.010148:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d55c3689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2351:x1869325552061056:12345-192.168.202.31@tcp:8: Request processed in 881us (5435us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727895.010157:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 8 00000100:00100000:0.0:1782727895.010183:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 9 00000100:00100000:0.0:1782727895.010188:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1869325552061184:12345-192.168.202.31@tcp:8: 00010000:00080000:0.0:1782727895.010207:0:6604:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0001: connection from f9926b93-a1e5-4dad-ade1-7cd7c966fac6@192.168.202.31@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:0.0:1782727895.010232:0:6604:0:(genops.c:1406:class_connect()) connect: client f9926b93-a1e5-4dad-ade1-7cd7c966fac6, cookie 0x22171c6c29614da0 00002000:00100000:0.0:1782727895.010239:0:6604:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f9926b93-a1e5-4dad-ade1-7cd7c966fac6/ffff8d56c7565000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782727895.010253:0:6604:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782727895.010535:0:6604:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782727895.010556:0:6604:0:(import.c:65:import_set_state_nolock()) ffff8d56c7562800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782727895.010596:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f55e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2351:x1869325552061184:12345-192.168.202.31@tcp:8: Request processed in 407us (3566us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727895.010604:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 9 00010000:00010000:0.0:1782727895.036545:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782727895.037501:0:5809:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 27823us 00000004:00200000:3.0:1782727895.064799:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1782727895.066902:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f55e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:5554:x1869325552061440:12345-192.168.202.31@tcp:33: Request processed in 57636us (57874us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727895.066926:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 0 00000100:00100000:3.0:1782727895.296680:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727895.300378:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552061568 00000100:00100000:1.0:1782727895.300401:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552061568 00000100:00100000:1.0:1782727895.300550:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 8 00000100:00100000:1.0:1782727895.300563:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:5594:x1869325552061568:12345-192.168.202.31@tcp:101: 00010000:00010000:1.0:1782727895.300591:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727895.304574:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c29614da7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20a21 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727895.304809:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0000/0x22171c6c29614dae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727895.304822:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0000/0x22171c6c29614dae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727895.304838:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0000/0x22171c6c29614dae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782727895.305294:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1782727895.305299:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782727895.305391:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0000/0x22171c6c29614dae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727895.305423:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c29614da7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a21 expref: 8 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727895.305442:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0000/0x22171c6c29614dae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a21 expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727895.305451:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d03b0000) 00010000:00010000:1.0:1782727895.305454:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782727895.305465:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f94b0000, rc 0) 00000100:00100000:1.0:1782727895.305743:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f55e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:5594:x1869325552061568:12345-192.168.202.31@tcp:101: Request processed in 5172us (9067us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727895.305752:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 8 00010000:00010000:0.0:1782727896.052597:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727897.069782:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727897.483058:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727897.483374:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552061696 00000100:00100000:3.0:1782727897.483393:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552061696 00000100:00100000:3.0:1782727897.483506:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 9 00000100:00080000:0.0:1782727897.483570:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727897.483597:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:5647:x1869325552061696:12345-192.168.202.31@tcp:41: 00000004:00000024:3.0:1782727897.483658:0:5806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1782727897.483755:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:5647:x1869325552061696:12345-192.168.202.31@tcp:41: Request processed in 163us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727897.483764:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 9 00000100:00100000:3.0:1782727897.489225:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727897.489339:0:8059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552061824 00000100:00100000:1.0:1782727897.489355:0:8059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552061824 00000100:00100000:1.0:1782727897.489669:0:8059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 8 00000100:00100000:1.0:1782727897.489680:0:8059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:5647:x1869325552061824:12345-192.168.202.31@tcp:13: 00002000:00000024:1.0:1782727897.489729:0:8059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782727897.489810:0:8059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f55e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:5647:x1869325552061824:12345-192.168.202.31@tcp:13: Request processed in 132us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727897.489818:0:8059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 8 00000100:00100000:2.0:1782727897.493728:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727897.494050:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552061952 00000100:00100000:3.0:1782727897.494076:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552061952 00000100:00080000:0.0:1782727897.494191:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782727897.494199:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727897.494856:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 9 00000100:00100000:3.0:1782727897.494870:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d55c368b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:5647:x1869325552061952:12345-192.168.202.31@tcp:13: 00002000:00000024:3.0:1782727897.494952:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782727897.495050:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d55c368b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:5647:x1869325552061952:12345-192.168.202.31@tcp:13: Request processed in 183us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727897.495059:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 9 00000001:00100000:1.0:1782727897.857966:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f9926b93-a1e5-4dad-ade1-7cd7c966fac6 00010000:00010000:1.0:1782727898.098717:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782727898.324145:0:6630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f9926b93-a1e5-4dad-ade1-7cd7c966fac6 00000100:00100000:1.0:1782727898.733785:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782727898.733817:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572005248:0@lo:13: 00000100:00100000:1.0:1782727898.733906:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727898.734053:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572005248 00000100:00100000:3.0:1782727898.734062:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572005248 00000100:00080000:0.0:1782727898.734259:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727898.734347:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782727898.734358:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572005248:12345-0@lo:13: 00002000:00000024:3.0:1782727898.734388:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782727898.734456:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572005248:12345-0@lo:13: Request processed in 99us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727898.734465:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1782727898.734557:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f55e2a00 x1869325572005248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727898.734579:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572005248:0@lo:13: 00000100:00100000:0.0:1782727898.735275:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572005376:0@lo:400: 00000100:00100000:0.0:1782727898.735330:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727898.735366:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572005888:0@lo:400: 00000100:00100000:0.0:1782727898.735411:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727898.735438:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727898.735443:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869325572005504:0@lo:400: 00000100:00100000:0.0:1782727898.735469:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727898.735495:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869325572005760:0@lo:400: 00000100:00100000:0.0:1782727898.735540:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727898.735558:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782727898.735570:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869325572005632:0@lo:400: 00000100:00100000:0.0:1782727898.735592:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727898.735622:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572005376 00000100:00100000:0.0:1782727898.735628:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572005376 00000100:00100000:0.0:1782727898.735667:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1782727898.735674:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3316:x1869325572005376:12345-0@lo:400: 00000100:00100000:0.0:1782727898.735718:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3316:x1869325572005376:12345-0@lo:400: Request processed in 44us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727898.735725:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1782727898.735757:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572005504 00000100:00100000:0.0:1782727898.735760:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572005504 00000100:00100000:0.0:1782727898.735783:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572005760 00000100:00100000:0.0:1782727898.735786:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572005760 00000100:00100000:0.0:1782727898.735806:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572005632 00000100:00100000:0.0:1782727898.735808:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572005632 00000100:00100000:0.0:1782727898.735821:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782727898.735828:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869325572005504:12345-0@lo:400: 00000100:00100000:0.0:1782727898.735858:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869325572005504:12345-0@lo:400: Request processed in 31us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727898.735863:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782727898.735875:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782727898.735881:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff74a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869325572005760:12345-0@lo:400: 00000100:00100000:0.0:1782727898.735909:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff74a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869325572005760:12345-0@lo:400: Request processed in 29us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727898.735914:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782727898.735925:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782727898.735930:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869325572005632:12345-0@lo:400: 00000100:00100000:0.0:1782727898.735954:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869325572005632:12345-0@lo:400: Request processed in 25us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727898.735969:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782727898.736013:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869325572005504:0@lo:400: 00000100:00100000:0.0:1782727898.736022:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572005376:0@lo:400: 00000100:00080000:0.0:1782727898.736055:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727898.736071:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869325572005632:0@lo:400: 00000100:00100000:0.0:1782727898.736159:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869325572005760:0@lo:400: 00000100:00100000:3.0:1782727898.738805:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572005888 00000100:00100000:3.0:1782727898.738822:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572005888 00000100:00100000:3.0:1782727898.738906:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782727898.738917:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff74bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572005888:12345-0@lo:400: 00000100:00100000:3.0:1782727898.739032:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff74bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572005888:12345-0@lo:400: Request processed in 117us (3619us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727898.739050:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1782727898.739226:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56d09aad80 x1869325572005888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727898.739243:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572005888:0@lo:400: 00000100:00080000:2.0:1782727898.741224:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782727899.117807:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727899.247112:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572006016:0@lo:13: 00000100:00100000:2.0:1782727899.247207:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727899.247247:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572006016 00000100:00100000:3.0:1782727899.247259:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572006016 00000100:00100000:3.0:1782727899.247329:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782727899.247340:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d55c3688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572006016:12345-0@lo:13: 00002000:00000024:3.0:1782727899.247407:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782727899.247983:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d55c3688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572006016:12345-0@lo:13: Request processed in 642us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727899.247993:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1782727899.252323:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f59e6300 x1869325572006016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727899.252360:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572006016:0@lo:13: 00000001:00100000:2.0:1782727899.339484:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f9926b93-a1e5-4dad-ade1-7cd7c966fac6 00010000:00010000:1.0:1782727900.144772:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727900.395374:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727900.395417:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727900.395450:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727900.395480:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727900.395534:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552062336 00000100:00100000:1.0:1782727900.395547:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552062336 00000100:00100000:1.0:1782727900.395618:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552062464 00000100:00100000:1.0:1782727900.395622:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552062464 00000100:00100000:1.0:1782727900.395643:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4 00000100:00100000:1.0:1782727900.395665:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2353:x1869325552062336:12345-192.168.202.31@tcp:400: 00000100:00100000:1.0:1782727900.395761:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2353:x1869325552062336:12345-192.168.202.31@tcp:400: Request processed in 99us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727900.395771:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4 00000100:00100000:1.0:1782727900.395790:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5 00000100:00100000:1.0:1782727900.395797:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2353:x1869325552062464:12345-192.168.202.31@tcp:400: 00000100:00100000:1.0:1782727900.395824:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2353:x1869325552062464:12345-192.168.202.31@tcp:400: Request processed in 28us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727900.395830:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5 00000100:00100000:1.0:1782727900.395850:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552062208 00000100:00100000:1.0:1782727900.395853:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552062208 00000100:00100000:1.0:1782727900.395885:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23 00000100:00100000:1.0:1782727900.395892:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2353:x1869325552062208:12345-192.168.202.31@tcp:400: 00000100:00100000:1.0:1782727900.395919:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2353:x1869325552062208:12345-192.168.202.31@tcp:400: Request processed in 29us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727900.395925:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23 00000100:00080000:1.0:1782727900.395947:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782727900.395952:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782727900.395954:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727900.398968:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552062080 00000100:00100000:2.0:1782727900.398983:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552062080 00000100:00100000:2.0:1782727900.399050:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 129 00000100:00100000:2.0:1782727900.399060:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+10:2353:x1869325552062080:12345-192.168.202.31@tcp:400: 00000100:00100000:2.0:1782727900.399203:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+10:2353:x1869325552062080:12345-192.168.202.31@tcp:400: Request processed in 144us (3843us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727900.399212:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 129 00000001:02000400:1.0:1782727900.625988:0:8150:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1782727901.166225:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727902.204917:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727903.216125:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727903.854336:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572006144:0@lo:13: 00000100:00100000:0.0:1782727903.854410:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727903.855262:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572006144 00000100:00100000:3.0:1782727903.855273:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572006144 00000100:00100000:3.0:1782727903.855374:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782727903.855384:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572006144:12345-0@lo:13: 00002000:00000024:3.0:1782727903.855422:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782727903.855483:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572006144:12345-0@lo:13: Request processed in 100us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727903.855489:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1782727903.855674:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782727903.856966:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f55e1880 x1869325572006144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727903.856994:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572006144:0@lo:13: 00000100:00100000:0.0:1782727903.858382:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c3689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869325572006528:0@lo:400: 00000100:00100000:0.0:1782727903.858454:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727903.858502:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727903.858540:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c368b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869325572006400:0@lo:400: 00000100:00100000:0.0:1782727903.858564:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727903.858600:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572006528 00000100:00100000:0.0:1782727903.858623:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572006528 00000100:00100000:0.0:1782727903.858669:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572006400 00000100:00100000:0.0:1782727903.858671:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572006400 00000100:00100000:0.0:1782727903.858689:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782727903.858697:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869325572006528:12345-0@lo:400: 00000100:00100000:0.0:1782727903.858748:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff749f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869325572006528:12345-0@lo:400: Request processed in 51us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727903.858754:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782727903.858769:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782727903.858775:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff74b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869325572006400:12345-0@lo:400: 00000100:00100000:0.0:1782727903.858798:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff74b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869325572006400:12345-0@lo:400: Request processed in 24us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727903.858803:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782727903.858835:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c368b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869325572006400:0@lo:400: 00000100:00100000:0.0:1782727903.858843:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c3689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869325572006528:0@lo:400: 00000100:00100000:0.0:1782727903.858883:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c368a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869325572006656:0@lo:400: 00000100:00100000:0.0:1782727903.858906:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727903.858923:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782727903.858928:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c3689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572006272:0@lo:400: 00000100:00100000:0.0:1782727903.858953:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727903.858977:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572006784:0@lo:400: 00000100:00100000:0.0:1782727903.859000:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727903.859023:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572006272 00000100:00100000:0.0:1782727903.859026:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572006272 00000100:00100000:0.0:1782727903.859054:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1782727903.859073:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3314:x1869325572006272:12345-0@lo:400: 00000100:00100000:0.0:1782727903.859119:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3314:x1869325572006272:12345-0@lo:400: Request processed in 47us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727903.859126:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1782727903.859155:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572006656 00000100:00100000:0.0:1782727903.859172:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572006656 00000100:00100000:0.0:1782727903.859192:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782727903.859198:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff74b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869325572006656:12345-0@lo:400: 00000100:00100000:0.0:1782727903.859225:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff74b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869325572006656:12345-0@lo:400: Request processed in 28us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727903.859231:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782727903.859253:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c3689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572006272:0@lo:400: 00000100:00100000:0.0:1782727903.859263:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c368a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869325572006656:0@lo:400: 00000100:00100000:1.0:1782727903.859540:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572006784 00000100:00100000:1.0:1782727903.859545:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572006784 00000100:00100000:1.0:1782727903.859577:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782727903.859585:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572006784:12345-0@lo:400: 00000100:00100000:1.0:1782727903.859626:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572006784:12345-0@lo:400: Request processed in 42us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727903.859639:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1782727903.859663:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782727903.859668:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782727903.860069:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d55c368bb80 x1869325572006784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727903.860086:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572006784:0@lo:400: 00010000:00010000:1.0:1782727904.239085:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727904.368006:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782727904.368030:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff74ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572006912:0@lo:13: 00000100:00100000:0.0:1782727904.368272:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727904.368386:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572006912 00000100:00100000:3.0:1782727904.368394:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572006912 00000100:00100000:3.0:1782727904.368459:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782727904.368469:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572006912:12345-0@lo:13: 00002000:00000024:3.0:1782727904.368504:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782727904.368564:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572006912:12345-0@lo:13: Request processed in 97us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727904.368571:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1782727904.368760:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ff74ad80 x1869325572006912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727904.370581:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff74ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572006912:0@lo:13: 00000020:00000080:2.0:1782727904.997240:0:8298:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc15d14510 20000000:00000080:2.0:1782727904.997260:0:8298:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d5701530000 uarg=0000000000000000 20000000:01000000:2.0:1782727904.997386:0:8298:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1782727904.997389:0:8298:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1782727904.997391:0:8298:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1782727904.997396:0:8298:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1782727904.997409:0:8298:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1782727904.997423:0:8298:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1782727904.997426:0:8298:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1782727904.997987:0:8298:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1782727904.997991:0:8298:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1782727905.000859:0:8299:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1782727905.001941:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1782727905.001998:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1782727905.002032:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1782727905.002056:0:8298:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1782727905.002060:0:8298:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1782727905.003164:0:8300:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1782727905.004331:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1782727905.004408:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1782727905.004443:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1782727905.004456:0:8298:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1782727905.004459:0:8298:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1782727905.006213:0:8301:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1782727905.007279:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1782727905.007336:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1782727905.007395:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1782727905.007420:0:8298:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1782727905.007422:0:8298:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1782727905.009107:0:8302:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1782727905.010159:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1782727905.010231:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1782727905.010272:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:2.0:1782727905.010291:0:8298:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1782727905.010312:0:8298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d56dd3cea00/0x22171c6c29614db5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.010332:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d56c0031600/0x22171c6c29614cb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614cab expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.010355:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d56cc3d9e00/0x22171c6c29614cdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614cd5 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.010364:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d56cc3d8400/0x22171c6c29614d06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614cff expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.010370:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d56cc3d8800/0x22171c6c29614d14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614d0d expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.010386:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d56cc3d9000/0x22171c6c29614d22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614d1b expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.010394:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d56f94b1200/0x22171c6c29614d3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614d37 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.010402:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d56f94b0e00/0x22171c6c29614d68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614d61 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.010412:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d56dd3cec00/0x22171c6c29614d76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f209bf expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.010420:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d56c0031400/0x22171c6c29614d7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f209c6 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.010429:0:8298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d56dd3cea00/0x22171c6c29614db5 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.010468:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d56c0031400/0x22171c6c29614d7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f209c6 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.010484:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d56c0031400/0x22171c6c29614d7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f209c6 expref: 9 pid: 5801 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727905.010499:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c3688a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869325572007040:192.168.202.31@tcp:104: 00010000:00010000:2.0:1782727905.010888:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d56dd3cec00/0x22171c6c29614d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f209bf expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.010899:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d56dd3cec00/0x22171c6c29614d76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f209bf expref: 9 pid: 5800 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727905.010916:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c3688380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869325572007168:192.168.202.31@tcp:104: 00010000:00010000:2.0:1782727905.010952:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d56f94b0e00/0x22171c6c29614d68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22171c6c29614d61 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.010961:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d56f94b0e00/0x22171c6c29614d68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22171c6c29614d61 expref: 18 pid: 5800 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727905.010971:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c368b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869325572007296:0@lo:104: 00000100:00100000:2.0:1782727905.011012:0:8298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782727905.011041:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d56f94b1200/0x22171c6c29614d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22171c6c29614d37 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.011062:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d56f94b1200/0x22171c6c29614d3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22171c6c29614d37 expref: 18 pid: 5800 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727905.011071:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c368a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869325572007424:0@lo:104: 00000100:00100000:2.0:1782727905.011097:0:8298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782727905.011124:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d56cc3d9000/0x22171c6c29614d22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22171c6c29614d1b expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.011133:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d56cc3d9000/0x22171c6c29614d22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22171c6c29614d1b expref: 18 pid: 5798 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727905.011141:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c3689180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869325572007552:0@lo:104: 00010000:00010000:2.0:1782727905.011163:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d56cc3d8800/0x22171c6c29614d14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22171c6c29614d0d expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.011171:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d56cc3d8800/0x22171c6c29614d14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22171c6c29614d0d expref: 18 pid: 5801 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727905.011187:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c3689f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869325572007680:0@lo:104: 00010000:00010000:2.0:1782727905.011215:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d56cc3d8400/0x22171c6c29614d06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22171c6c29614cff expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.011222:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d56cc3d8400/0x22171c6c29614d06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22171c6c29614cff expref: 18 pid: 5801 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727905.011229:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c368b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869325572007808:0@lo:104: 00010000:00010000:2.0:1782727905.011270:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d56cc3d9e00/0x22171c6c29614cdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22171c6c29614cd5 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.011277:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d56cc3d9e00/0x22171c6c29614cdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22171c6c29614cd5 expref: 18 pid: 5800 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727905.011284:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c7438380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869325572007936:0@lo:104: 00010000:00010000:2.0:1782727905.011307:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d56c0031600/0x22171c6c29614cb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22171c6c29614cab expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.011314:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d56c0031600/0x22171c6c29614cb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22171c6c29614cab expref: 18 pid: 5801 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727905.011321:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c743a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869325572008064:0@lo:104: 00000100:00100000:2.0:1782727905.011332:0:8298:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c2f48480 going to sleep for 11 seconds 00000100:00100000:2.0:1782727905.012070:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782727905.012102:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727905.012121:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727905.012131:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727905.012140:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727905.012161:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727905.012171:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572007296 00000100:00100000:2.0:1782727905.012178:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572007296 00000100:00100000:2.0:1782727905.012218:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572007424 00000100:00100000:2.0:1782727905.012221:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572007424 00000100:00100000:2.0:1782727905.012229:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572007552 00000100:00100000:2.0:1782727905.012231:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572007552 00000100:00100000:2.0:1782727905.012238:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572007680 00000100:00100000:2.0:1782727905.012240:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572007680 00000100:00100000:2.0:1782727905.012247:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572007808 00000100:00100000:2.0:1782727905.012249:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572007808 00000100:00100000:2.0:1782727905.012257:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572007936 00000100:00100000:2.0:1782727905.012259:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572007936 00000100:00100000:2.0:1782727905.012265:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572008064 00000100:00100000:2.0:1782727905.012266:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572008064 00000100:00100000:2.0:1782727905.012277:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782727905.012284:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d55c368bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+9:8298:x1869325572007296:12345-0@lo:104: 00010000:00010000:2.0:1782727905.012298:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8d57021c1000/0x22171c6c29614d61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614d68 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.012371:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782727905.012376:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d55c368bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+9:8298:x1869325572007296:12345-0@lo:104: Request processed in 93us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727905.012383:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782727905.012401:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782727905.012407:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5701533c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+8:8298:x1869325572007424:12345-0@lo:104: 00010000:00010000:2.0:1782727905.012414:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8d57021c0600/0x22171c6c29614d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614d3e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.012447:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782727905.012453:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5701533c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+8:8298:x1869325572007424:12345-0@lo:104: Request processed in 47us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727905.012464:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782727905.012494:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782727905.012499:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c7439880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+7:8298:x1869325572007552:12345-0@lo:104: 00010000:00010000:2.0:1782727905.012506:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8e00/0x22171c6c29614d1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614d22 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.012556:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1782727905.012561:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c7439880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+7:8298:x1869325572007552:12345-0@lo:104: Request processed in 62us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727905.012566:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782727905.012578:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782727905.012583:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c743aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+6:8298:x1869325572007680:12345-0@lo:104: 00010000:00010000:2.0:1782727905.012726:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9200/0x22171c6c29614d0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614d14 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.012756:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1782727905.012762:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c743aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+6:8298:x1869325572007680:12345-0@lo:104: Request processed in 179us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727905.012768:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782727905.012780:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782727905.012785:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c7438e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+5:8298:x1869325572007808:12345-0@lo:104: 00010000:00010000:2.0:1782727905.012792:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cf800/0x22171c6c29614cff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614d06 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.012817:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1782727905.012822:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c7438e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+5:8298:x1869325572007808:12345-0@lo:104: Request processed in 38us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727905.012833:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782727905.012845:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782727905.012851:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c743bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+4:8298:x1869325572007936:12345-0@lo:104: 00010000:00010000:2.0:1782727905.012858:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614cd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614cdc expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.012884:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1782727905.012889:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c743bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+4:8298:x1869325572007936:12345-0@lo:104: Request processed in 40us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727905.012894:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782727905.012904:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782727905.012909:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c7439180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+3:8298:x1869325572008064:12345-0@lo:104: 00010000:00010000:2.0:1782727905.012915:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8d57021c1800/0x22171c6c29614cab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614cb2 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.012939:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1782727905.012943:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c7439180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+3:8298:x1869325572008064:12345-0@lo:104: Request processed in 36us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727905.012948:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782727905.012994:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c368b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869325572007296:0@lo:104: 00000100:00100000:2.0:1782727905.013003:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c368a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869325572007424:0@lo:104: 00000100:00100000:2.0:1782727905.013010:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c3689180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869325572007552:0@lo:104: 00000100:00100000:2.0:1782727905.013016:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c3689f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869325572007680:0@lo:104: 00000100:00100000:2.0:1782727905.013022:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c368b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869325572007808:0@lo:104: 00000100:00100000:2.0:1782727905.013028:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c7438380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869325572007936:0@lo:104: 00000100:00100000:2.0:1782727905.013042:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c743a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869325572008064:0@lo:104: 00010000:00010000:0.0:1782727905.013475:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1782727905.013482:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8d57021c1000/0x22171c6c29614d61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614d68 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727905.013489:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d57021c1000 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:0.0:1782727905.013494:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8d57021c1000/0x22171c6c29614d61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x22171c6c29614d68 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727905.013503:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8d57021c1000/0x22171c6c29614d61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x22171c6c29614d68 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727905.013537:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8d57021c1000/0x22171c6c29614d61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x22171c6c29614d68 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727905.013543:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727905.013770:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8d57021c1000/0x22171c6c29614d61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614d68 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727905.013778:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782727905.013833:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1782727905.013904:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8d57021c1000/0x22171c6c29614d61 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614d68 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727905.013911:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8d57021c1000/0x22171c6c29614d61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614d68 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727905.013928:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1782727905.013931:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8d57021c0600/0x22171c6c29614d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614d3e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727905.013936:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d57021c0600 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:0.0:1782727905.013947:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8d57021c0600/0x22171c6c29614d37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x22171c6c29614d3e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727905.013953:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8d57021c0600/0x22171c6c29614d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x22171c6c29614d3e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727905.013959:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8d57021c0600/0x22171c6c29614d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x22171c6c29614d3e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727905.013963:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727905.013992:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8d57021c0600/0x22171c6c29614d37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614d3e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727905.013998:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727905.014016:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8d57021c0600/0x22171c6c29614d37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614d3e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727905.014022:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8d57021c0600/0x22171c6c29614d37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614d3e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727905.014033:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1782727905.014035:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8e00/0x22171c6c29614d1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614d22 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727905.014040:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56cc3d8e00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:0.0:1782727905.014043:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8e00/0x22171c6c29614d1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x22171c6c29614d22 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727905.014060:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8e00/0x22171c6c29614d1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x22171c6c29614d22 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727905.014076:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8e00/0x22171c6c29614d1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x22171c6c29614d22 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727905.014081:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727905.014096:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8e00/0x22171c6c29614d1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614d22 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727905.014102:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727905.014108:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8e00/0x22171c6c29614d1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614d22 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727905.014115:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8e00/0x22171c6c29614d1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614d22 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727905.014126:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1782727905.014129:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9200/0x22171c6c29614d0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614d14 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727905.014134:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56cc3d9200 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:0.0:1782727905.014137:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9200/0x22171c6c29614d0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x22171c6c29614d14 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727905.014143:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9200/0x22171c6c29614d0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x22171c6c29614d14 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727905.014149:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9200/0x22171c6c29614d0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x22171c6c29614d14 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727905.014154:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782727905.014175:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9200/0x22171c6c29614d0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614d14 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727905.014182:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782727905.014391:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1782727905.014815:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572008320:0@lo:103: 00000100:00100000:1.0:1782727905.014872:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727905.014921:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782727905.014927:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff74b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572008448:0@lo:103: 00000100:00100000:1.0:1782727905.014948:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727905.015005:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572008320 00000100:00100000:2.0:1782727905.015012:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572008320 00010000:00010000:2.0:1782727905.015038:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d56f94b1200/0x22171c6c29614d3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614d37 expref: 19 pid: 5800 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727905.015079:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572008448 00000100:00100000:2.0:1782727905.015083:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572008448 00010000:00010000:2.0:1782727905.015094:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d56cc3d9000/0x22171c6c29614d22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614d1b expref: 20 pid: 5798 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727905.015113:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782727905.015120:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+20:3314:x1869325572008320:12345-0@lo:103: 00010000:00010000:2.0:1782727905.015133:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727905.015138:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d56f94b1200/0x22171c6c29614d3e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614d37 expref: 20 pid: 5800 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.015147:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d56f94b1200/0x22171c6c29614d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22171c6c29614d37 expref: 20 pid: 5800 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.015161:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56f94b1200/0x22171c6c29614d3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22171c6c29614d37 expref: 20 pid: 5800 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.015175:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782727905.015213:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3314:x1869325572008320:12345-0@lo:103: Request processed in 93us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727905.015219:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782727905.015235:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782727905.015242:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:3314:x1869325572008448:12345-0@lo:103: 00010000:00010000:2.0:1782727905.015260:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727905.015264:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d56cc3d9000/0x22171c6c29614d22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614d1b expref: 18 pid: 5798 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.015272:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d56cc3d9000/0x22171c6c29614d22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22171c6c29614d1b expref: 18 pid: 5798 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.015281:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56cc3d9000/0x22171c6c29614d22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22171c6c29614d1b expref: 18 pid: 5798 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.015291:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782727905.015312:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:3314:x1869325572008448:12345-0@lo:103: Request processed in 72us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727905.015318:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782727905.016170:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff74b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572008448:0@lo:103: 00000100:00100000:1.0:1782727905.016182:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572008320:0@lo:103: 00000100:00100000:3.0:1782727905.018725:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572008576:0@lo:103: 00000100:00100000:3.0:1782727905.018798:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727905.018854:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff74ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572008192:0@lo:103: 00000100:00100000:3.0:1782727905.018873:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727905.018922:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572008576 00000100:00100000:3.0:1782727905.018930:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572008576 00010000:00010000:3.0:1782727905.018977:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d56cc3d8800/0x22171c6c29614d14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614d0d expref: 17 pid: 5801 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727905.019010:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572008192 00000100:00100000:3.0:1782727905.019013:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572008192 00010000:00010000:3.0:1782727905.019025:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d56f94b0e00/0x22171c6c29614d68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614d61 expref: 18 pid: 5800 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727905.019038:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782727905.019046:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:3316:x1869325572008576:12345-0@lo:103: 00010000:00010000:3.0:1782727905.019072:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727905.019077:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d56cc3d8800/0x22171c6c29614d14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614d0d expref: 18 pid: 5801 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.019086:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d56cc3d8800/0x22171c6c29614d14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22171c6c29614d0d expref: 18 pid: 5801 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.019102:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56cc3d8800/0x22171c6c29614d14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22171c6c29614d0d expref: 18 pid: 5801 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.019117:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727905.019150:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f55e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:3316:x1869325572008576:12345-0@lo:103: Request processed in 104us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727905.019157:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782727905.019173:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782727905.019179:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:3316:x1869325572008192:12345-0@lo:103: 00010000:00010000:3.0:1782727905.019186:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727905.019191:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d56f94b0e00/0x22171c6c29614d68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614d61 expref: 16 pid: 5800 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.019209:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d56f94b0e00/0x22171c6c29614d68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22171c6c29614d61 expref: 16 pid: 5800 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.019220:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56f94b0e00/0x22171c6c29614d68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22171c6c29614d61 expref: 16 pid: 5800 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.019228:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727905.019251:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f55e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:3316:x1869325572008192:12345-0@lo:103: Request processed in 72us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727905.019258:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782727905.019292:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572008576:0@lo:103: 00000100:00100000:3.0:1782727905.019300:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff74ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572008192:0@lo:103: 00010000:00010000:1.0:1782727905.028855:0:8303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782727905.029148:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cf800/0x22171c6c29614cff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614d06 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.029163:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3cf800 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:3.0:1782727905.029168:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cf800/0x22171c6c29614cff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x22171c6c29614d06 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.029178:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cf800/0x22171c6c29614cff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x22171c6c29614d06 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727905.029185:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cf800/0x22171c6c29614cff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x22171c6c29614d06 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727905.029192:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727905.029270:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cf800/0x22171c6c29614cff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614d06 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.029287:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727905.029308:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cf800/0x22171c6c29614cff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614d06 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.029315:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cf800/0x22171c6c29614cff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614d06 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.029331:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727905.029348:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8d57021c1800/0x22171c6c29614cab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614cb2 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.029353:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d57021c1800 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:3.0:1782727905.029356:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8d57021c1800/0x22171c6c29614cab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x22171c6c29614cb2 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.029362:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8d57021c1800/0x22171c6c29614cab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x22171c6c29614cb2 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727905.029367:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8d57021c1800/0x22171c6c29614cab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x22171c6c29614cb2 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727905.029371:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782727905.029385:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8d57021c1800/0x22171c6c29614cab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614cb2 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.029389:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727905.029403:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8d57021c1800/0x22171c6c29614cab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614cb2 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.029409:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8d57021c1800/0x22171c6c29614cab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614cb2 expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.029426:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727905.029428:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727905.029431:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727905.029448:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572008832:0@lo:103: 00000100:00100000:3.0:1782727905.029545:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727905.029633:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572008832 00000100:00100000:3.0:1782727905.029640:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572008832 00010000:00010000:3.0:1782727905.029668:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d56c0031600/0x22171c6c29614cb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614cab expref: 15 pid: 5801 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727905.029697:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782727905.029705:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:3314:x1869325572008832:12345-0@lo:103: 00010000:00010000:3.0:1782727905.029718:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727905.029722:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d56c0031600/0x22171c6c29614cb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614cab expref: 15 pid: 5801 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.029732:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d56c0031600/0x22171c6c29614cb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22171c6c29614cab expref: 15 pid: 5801 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.029744:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56c0031600/0x22171c6c29614cb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22171c6c29614cab expref: 15 pid: 5801 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.029758:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727905.029790:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:3314:x1869325572008832:12345-0@lo:103: Request processed in 85us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727905.029797:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782727905.029834:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572008832:0@lo:103: 00000100:00100000:3.0:1782727905.029869:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3317:1869325572008704:0@lo:103: 00000100:00100000:3.0:1782727905.029893:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727905.029920:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572008704 00000100:00100000:3.0:1782727905.029924:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572008704 00010000:00010000:3.0:1782727905.029937:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d56cc3d8400/0x22171c6c29614d06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614cff expref: 14 pid: 5801 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727905.029958:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782727905.029966:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:3317:x1869325572008704:12345-0@lo:103: 00010000:00010000:3.0:1782727905.029973:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727905.029977:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d56cc3d8400/0x22171c6c29614d06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614cff expref: 14 pid: 5801 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.029984:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d56cc3d8400/0x22171c6c29614d06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22171c6c29614cff expref: 14 pid: 5801 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.029993:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56cc3d8400/0x22171c6c29614d06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22171c6c29614cff expref: 14 pid: 5801 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.030004:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727905.030030:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:3317:x1869325572008704:12345-0@lo:103: Request processed in 66us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727905.030036:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782727905.030076:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3317:1869325572008704:0@lo:103: 00010000:00010000:3.0:1782727905.030486:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727905.030489:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727905.030490:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727905.030538:0:8303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614cd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614cdc expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727905.030547:0:8303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3cfa00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:1.0:1782727905.030550:0:8303:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614cd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x22171c6c29614cdc expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727905.030558:0:8303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614cd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x22171c6c29614cdc expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782727905.030564:0:8303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614cd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x22171c6c29614cdc expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727905.030594:0:8303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782727905.030631:0:8303:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614cd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614cdc expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727905.030638:0:8303:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782727905.030649:0:8303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614cd5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614cdc expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727905.030655:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cfa00/0x22171c6c29614cd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614cdc expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727905.030666:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727905.030668:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727905.030669:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727905.030809:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3315:1869325572008960:0@lo:103: 00000100:00100000:3.0:1782727905.030856:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727905.030932:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572008960 00000100:00100000:1.0:1782727905.030937:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572008960 00010000:00010000:1.0:1782727905.030958:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d56cc3d9e00/0x22171c6c29614cdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614cd5 expref: 13 pid: 5800 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727905.030986:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782727905.030994:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:3315:x1869325572008960:12345-0@lo:103: 00010000:00010000:1.0:1782727905.031004:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727905.031009:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d56cc3d9e00/0x22171c6c29614cdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614cd5 expref: 13 pid: 5800 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727905.031017:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d56cc3d9e00/0x22171c6c29614cdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22171c6c29614cd5 expref: 13 pid: 5800 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727905.031029:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56cc3d9e00/0x22171c6c29614cdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22171c6c29614cd5 expref: 13 pid: 5800 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727905.031046:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782727905.031240:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:3315:x1869325572008960:12345-0@lo:103: Request processed in 246us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727905.031247:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782727905.031348:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3315:1869325572008960:0@lo:103: 00010000:00010000:0.0:1782727905.031504:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9200/0x22171c6c29614d0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614d14 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727905.031531:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9200/0x22171c6c29614d0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614d14 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727905.031552:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727905.031554:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727905.031556:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727905.042745:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c3688a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869325572007040:192.168.202.31@tcp:104: 00000100:00100000:2.0:1782727905.042763:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c3688380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869325572007168:192.168.202.31@tcp:104: 00010000:00010000:2.0:1782727905.042812:0:8298:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d56dd3cea00/0x22171c6c29614db5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727905.055107:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727905.055152:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727905.055252:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552062592 00000100:00100000:3.0:1782727905.055262:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552062592 00010000:00010000:3.0:1782727905.055302:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d56c0031400/0x22171c6c29614d7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f209c6 expref: 10 pid: 5801 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727905.055344:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552062720 00000100:00100000:3.0:1782727905.055347:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552062720 00010000:00010000:3.0:1782727905.055361:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d56dd3cec00/0x22171c6c29614d76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f209bf expref: 11 pid: 5800 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727905.055389:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 19 00000100:00100000:3.0:1782727905.055398:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c743a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b661aafc-708f-4f38-b71b-eec242d406b4+11:2352:x1869325552062592:12345-192.168.202.31@tcp:103: 00010000:00010000:3.0:1782727905.055413:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727905.055418:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8d56c0031400/0x22171c6c29614d7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f209c6 expref: 11 pid: 5801 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.055433:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d56c0031400/0x22171c6c29614d7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f209c6 expref: 11 pid: 5801 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.055449:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56c0031400/0x22171c6c29614d7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f209c6 expref: 11 pid: 5801 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.055468:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727905.055567:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c743a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b661aafc-708f-4f38-b71b-eec242d406b4+10:2352:x1869325552062592:12345-192.168.202.31@tcp:103: Request processed in 169us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727905.055574:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 19 00000100:00100000:3.0:1782727905.055606:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 20 00000100:00100000:3.0:1782727905.055845:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c7438380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b661aafc-708f-4f38-b71b-eec242d406b4+9:2352:x1869325552062720:12345-192.168.202.31@tcp:103: 00010000:00010000:3.0:1782727905.055854:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727905.055859:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8d56dd3cec00/0x22171c6c29614d76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f209bf expref: 9 pid: 5800 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.055868:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d56dd3cec00/0x22171c6c29614d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f209bf expref: 9 pid: 5800 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.055880:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56dd3cec00/0x22171c6c29614d76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f209bf expref: 9 pid: 5800 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.055893:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d56dd3cea00/0x22171c6c29614db5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.055901:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56dd3cea00/0x22171c6c29614db5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.055917:0:5791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d56dd3cea00/0x22171c6c29614db5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.055924:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d56dd3cea00/0x22171c6c29614db5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.055931:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d56dd3cea00/0x22171c6c29614db5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.055937:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d56dd3cea00/0x22171c6c29614db5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.055943:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3cea00 already unused, calling callback (ffffffffc152fcf0) 00010000:00010000:3.0:1782727905.055947:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d56dd3cea00/0x22171c6c29614db5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.055962:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d56dd3cea00/0x22171c6c29614db5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.055979:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d56dd3cea00/0x22171c6c29614db5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727905.055989:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727905.056011:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c7438380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b661aafc-708f-4f38-b71b-eec242d406b4+8:2352:x1869325552062720:12345-192.168.202.31@tcp:103: Request processed in 169us (858us total) trans 0 rc 0/0 00010000:00010000:2.0:1782727905.065470:0:8298:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d56dd3cea00/0x22171c6c29614db5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.065489:0:8298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d56dd3cea00/0x22171c6c29614db5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727905.065496:0:8298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56dd3cea00/0x22171c6c29614db5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727905.071006:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 20 00010000:00010000:3.0:1782727905.265378:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727905.507328:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727905.507369:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727905.507413:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727905.507448:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727905.507480:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552063104 00000100:00100000:0.0:1782727905.507480:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552062976 00000100:00100000:1.0:1782727905.507490:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552063104 00000100:00100000:0.0:1782727905.507490:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552062976 00000100:00100000:0.0:1782727905.507583:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 27 00000100:00100000:0.0:1782727905.507593:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2353:x1869325552062976:12345-192.168.202.31@tcp:400: 00000100:00100000:3.0:1782727905.507605:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552063232 00000100:00100000:3.0:1782727905.507609:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552063232 00000100:00100000:0.0:1782727905.507680:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2353:x1869325552062976:12345-192.168.202.31@tcp:400: Request processed in 88us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727905.507687:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 27 00000100:00080000:0.0:1782727905.507708:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782727905.507713:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782727905.507715:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727905.507735:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 7 00000100:00100000:1.0:1782727905.507742:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2353:x1869325552063104:12345-192.168.202.31@tcp:400: 00000100:00100000:1.0:1782727905.507768:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2353:x1869325552063104:12345-192.168.202.31@tcp:400: Request processed in 27us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727905.507774:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 7 00000100:00100000:2.0:1782727905.508397:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552062848 00000100:00100000:2.0:1782727905.508405:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552062848 00000100:00100000:2.0:1782727905.508449:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 131 00000100:00100000:2.0:1782727905.508457:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+8:2353:x1869325552062848:12345-192.168.202.31@tcp:400: 00000100:00100000:2.0:1782727905.509757:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+8:2353:x1869325552062848:12345-192.168.202.31@tcp:400: Request processed in 1291us (2428us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727905.509768:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 131 00000100:00100000:3.0:1782727905.510868:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 8 00000100:00100000:3.0:1782727905.510881:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2353:x1869325552063232:12345-192.168.202.31@tcp:400: 00000100:00100000:3.0:1782727905.510940:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2353:x1869325552063232:12345-192.168.202.31@tcp:400: Request processed in 63us (3490us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727905.510947:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 8 00010000:00010000:3.0:1782727906.285994:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782727906.670632:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782727906.670640:0:5803:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8d56d9e79800 from 39 10000000:01000000:3.0:1782727906.670646:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782727906.670695:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d57021c1800/0x22171c6c29614dbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727906.670707:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d57021c1800/0x22171c6c29614dbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727906.670740:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d57021c1800/0x22171c6c29614dbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727906.670781:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572009088:0@lo:101: 00000100:00100000:3.0:1782727906.670865:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727906.670942:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f9830300 going to sleep for 11 seconds 00000100:00100000:0.0:1782727906.672890:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572009088 00000100:00100000:0.0:1782727906.672902:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572009088 00000100:00100000:0.0:1782727906.672978:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1782727906.672988:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+12:5803:x1869325572009088:12345-0@lo:101: 00010000:00010000:0.0:1782727906.673004:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727906.673021:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56c0030200/0x22171c6c29614dc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614dbc expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727906.673082:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56c0030200/0x22171c6c29614dc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614dbc expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727906.673093:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56c0030200/0x22171c6c29614dc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614dbc expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727906.673101:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56c0030200, rc 0) 00000100:00100000:0.0:1782727906.673180:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:5803:x1869325572009088:12345-0@lo:101: Request processed in 193us (2315us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727906.673187:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1782727906.674859:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572009088:0@lo:101: 00010000:00010000:3.0:1782727906.674883:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d57021c1800/0x22171c6c29614dbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614dc3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727906.674895:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d57021c1800/0x22171c6c29614dbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614dc3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727906.674967:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572009216:0@lo:501: 00000100:00100000:3.0:1782727906.675019:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727906.675075:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f9830300 going to sleep for 11 seconds 00000100:00100000:2.0:1782727906.675148:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572009216 00000100:00100000:2.0:1782727906.675155:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572009216 00000100:00100000:2.0:1782727906.675201:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1782727906.675210:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:5803:x1869325572009216:12345-0@lo:501: 00000100:00100000:2.0:1782727906.675502:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:5803:x1869325572009216:12345-0@lo:501: Request processed in 293us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727906.675541:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1782727906.676086:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572009216:0@lo:501: 00000100:00100000:3.0:1782727906.676119:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572009344:0@lo:503: 00000100:00100000:3.0:1782727906.676163:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727906.676196:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f9830300 going to sleep for 11 seconds 00000100:00100000:2.0:1782727906.676249:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572009344 00000100:00100000:2.0:1782727906.676254:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572009344 00000100:00100000:2.0:1782727906.676292:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782727906.676300:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:5803:x1869325572009344:12345-0@lo:503: 00000100:00100000:2.0:1782727906.676467:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:5803:x1869325572009344:12345-0@lo:503: Request processed in 167us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727906.676473:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1782727906.676614:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572009344:0@lo:503: 00000100:00100000:0.0:1782727906.679669:0:8317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff74a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8317:1869325572009472:0@lo:502: 00000100:00100000:0.0:1782727906.679748:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727906.679927:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572009472 00000100:00100000:2.0:1782727906.679934:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572009472 00000100:00100000:2.0:1782727906.679984:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1782727906.679992:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:8317:x1869325572009472:12345-0@lo:502: 00000100:00100000:2.0:1782727906.680236:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:8317:x1869325572009472:12345-0@lo:502: Request processed in 243us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727906.680244:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1782727906.680419:0:8317:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c2ae4600 going to sleep for 11 seconds 00000100:00100000:0.0:1782727906.680442:0:8317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff74a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8317:1869325572009472:0@lo:502: 00000100:00100000:0.0:1782727906.680486:0:8317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff74a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8317:1869325572009600:0@lo:502: 00000100:00100000:0.0:1782727906.680561:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727906.680588:0:8317:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c2ae4600 going to sleep for 11 seconds 00000100:00100000:3.0:1782727906.680919:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572009600 00000100:00100000:3.0:1782727906.680924:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572009600 00000100:00100000:3.0:1782727906.680957:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1782727906.680964:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:8317:x1869325572009600:12345-0@lo:502: 00000100:00100000:3.0:1782727906.681127:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:8317:x1869325572009600:12345-0@lo:502: Request processed in 163us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727906.681139:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1782727906.681221:0:8317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff74a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8317:1869325572009600:0@lo:502: 00000040:00080000:0.0:1782727906.682287:0:8317:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1782727906.686672:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1782727906.686706:0:5803:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782727906.686720:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d57021c1800/0x22171c6c29614dbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614dc3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727906.686732:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d57021c1800/0x22171c6c29614dbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614dc3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727906.686742:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1782727906.686745:0:5803:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1782727906.686774:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1782727906.686821:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56f94b1600/0x22171c6c29614dca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727906.686829:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d56f94b1600/0x22171c6c29614dca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727906.686841:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d56f94b1600/0x22171c6c29614dca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727906.686863:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572009728:0@lo:101: 00000100:00100000:1.0:1782727906.686929:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727906.687201:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f9818b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782727906.698954:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572009728 00000100:00100000:3.0:1782727906.698969:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572009728 00000100:00100000:3.0:1782727906.699041:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1782727906.699052:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+13:5803:x1869325572009728:12345-0@lo:101: 00010000:00010000:3.0:1782727906.699145:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727906.699166:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d57021c0a00/0x22171c6c29614dd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614dca expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727906.699205:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d57021c0a00/0x22171c6c29614dd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614dca expref: 14 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727906.699216:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d57021c0a00/0x22171c6c29614dd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614dca expref: 14 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727906.699226:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d57021c0a00, rc 0) 00000100:00100000:3.0:1782727906.699292:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:5803:x1869325572009728:12345-0@lo:101: Request processed in 242us (12364us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727906.699299:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1782727906.699924:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572009728:0@lo:101: 00010000:00010000:1.0:1782727906.699946:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d56f94b1600/0x22171c6c29614dca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614dd1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727906.699956:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d56f94b1600/0x22171c6c29614dca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614dd1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727906.700028:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572009856:0@lo:501: 00000100:00100000:1.0:1782727906.700081:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727906.700123:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f9818b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782727906.700187:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572009856 00000100:00100000:0.0:1782727906.700193:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572009856 00000100:00100000:0.0:1782727906.700231:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1782727906.700238:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:5803:x1869325572009856:12345-0@lo:501: 00000100:00100000:0.0:1782727906.700543:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:5803:x1869325572009856:12345-0@lo:501: Request processed in 305us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727906.700559:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1782727906.700901:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572009856:0@lo:501: 00000100:00100000:1.0:1782727906.700935:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572009984:0@lo:503: 00000100:00100000:1.0:1782727906.700975:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727906.701007:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f9818b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782727906.701061:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572009984 00000100:00100000:0.0:1782727906.701065:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572009984 00000100:00100000:0.0:1782727906.701101:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1782727906.701108:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:5803:x1869325572009984:12345-0@lo:503: 00000100:00100000:0.0:1782727906.701254:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:5803:x1869325572009984:12345-0@lo:503: Request processed in 146us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727906.701261:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1782727906.701628:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572009984:0@lo:503: 00000100:00100000:1.0:1782727906.702472:0:8318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8318:1869325572010112:0@lo:502: 00000100:00100000:1.0:1782727906.702556:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727906.702587:0:8318:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f9818e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782727906.703081:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572010112 00000100:00100000:0.0:1782727906.703088:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572010112 00000100:00100000:0.0:1782727906.703133:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1782727906.703141:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:8318:x1869325572010112:12345-0@lo:502: 00000100:00100000:0.0:1782727906.703554:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:8318:x1869325572010112:12345-0@lo:502: Request processed in 413us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727906.703562:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1782727906.703661:0:8318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8318:1869325572010112:0@lo:502: 00000020:01000000:3.0:1782727906.703688:0:8318:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782727906.703697:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727906.703699:0:8318:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1782727906.703706:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782727906.703731:0:8318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8318:1869325572010240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727906.703769:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727906.703809:0:8318:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f98303c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727906.704908:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572010240 00000100:00100000:1.0:1782727906.704916:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572010240 00000100:00100000:1.0:1782727906.704969:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1782727906.704978:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:8318:x1869325572010240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727906.705195:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:8318:x1869325572010240:12345-0@lo:502:llog_process_th.0 Request processed in 217us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727906.705202:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1782727906.705620:0:8318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8318:1869325572010240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782727906.705647:0:8318:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782727906.705654:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727906.705655:0:8318:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1782727906.705659:0:8318:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1782727906.707467:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1782727906.707546:0:5803:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1782727906.707559:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56f94b1600/0x22171c6c29614dca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614dd1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727906.707570:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d56f94b1600/0x22171c6c29614dca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614dd1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727906.707580:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782727906.707583:0:5803:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8d56c75cf800 from 39 10000000:01000000:3.0:1782727906.707585:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782727906.707619:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d57021c0800/0x22171c6c29614dd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727906.707626:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d57021c0800/0x22171c6c29614dd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727906.707636:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d57021c0800/0x22171c6c29614dd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727906.707658:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572010368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782727906.707711:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727906.707767:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f9830e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782727906.707906:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572010368 00000100:00100000:0.0:1782727906.707913:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572010368 00000100:00100000:0.0:1782727906.707950:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1782727906.707958:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+14:5803:x1869325572010368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727906.707971:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727906.707984:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56c0031000/0x22171c6c29614ddf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614dd8 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727906.708007:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56c0031000/0x22171c6c29614ddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614dd8 expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727906.708017:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56c0031000/0x22171c6c29614ddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614dd8 expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727906.708044:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56c0031000, rc 0) 00000100:00100000:0.0:1782727906.708089:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:5803:x1869325572010368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727906.708096:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1782727906.708651:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572010368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727906.708667:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d57021c0800/0x22171c6c29614dd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614ddf expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727906.708676:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d57021c0800/0x22171c6c29614dd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614ddf expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727906.708732:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c743a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572010496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727906.708778:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727906.708804:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d02a39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727906.708819:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572010496 00000100:00100000:2.0:1782727906.708822:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572010496 00000100:00100000:2.0:1782727906.708853:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1782727906.708860:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:5803:x1869325572010496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727906.709111:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:5803:x1869325572010496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727906.709118:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1782727906.709147:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c743a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572010496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727906.709180:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c743a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572010624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727906.709216:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727906.709227:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d02a39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727906.709238:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572010624 00000100:00100000:2.0:1782727906.709241:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572010624 00000100:00100000:2.0:1782727906.709257:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1782727906.709262:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:5803:x1869325572010624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727906.710632:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:5803:x1869325572010624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1365us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727906.710643:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1782727906.710699:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c743a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572010624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727906.710909:0:8319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c743a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8319:1869325572010752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727906.710949:0:8319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727906.710970:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572010752 00000100:00100000:2.0:1782727906.710975:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572010752 00000100:00100000:2.0:1782727906.711000:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1782727906.711007:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:8319:x1869325572010752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727906.712720:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:8319:x1869325572010752:12345-0@lo:502:llog_process_th.0 Request processed in 1706us (1762us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727906.712731:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1782727906.714156:0:8319:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d02a3480 going to sleep for 11 seconds 00000100:00100000:2.0:1782727906.714459:0:8319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c743a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8319:1869325572010752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727906.714551:0:8319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c743a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8319:1869325572010880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727906.714619:0:8319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727906.714663:0:8319:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d02a3480 going to sleep for 11 seconds 00000100:00100000:1.0:1782727906.717804:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572010880 00000100:00100000:1.0:1782727906.717818:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572010880 00000100:00100000:1.0:1782727906.717874:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1782727906.717883:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:8319:x1869325572010880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727906.718406:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:8319:x1869325572010880:12345-0@lo:502:llog_process_th.0 Request processed in 522us (3785us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727906.718414:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1782727906.719055:0:8319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c743a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8319:1869325572010880:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1782727906.719097:0:8319:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1782727906.719472:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1782727906.719489:0:5803:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782727906.719499:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d57021c0800/0x22171c6c29614dd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614ddf expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727906.719551:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d57021c0800/0x22171c6c29614dd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614ddf expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727906.719576:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1782727906.719578:0:5803:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1782727906.719581:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782727906.719613:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d57021c0600/0x22171c6c29614de6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727906.719621:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d57021c0600/0x22171c6c29614de6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727906.719630:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d57021c0600/0x22171c6c29614de6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727906.719651:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572011008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782727906.719698:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727906.719729:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f98309c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727906.719948:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572011008 00000100:00100000:2.0:1782727906.719954:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572011008 00000100:00100000:2.0:1782727906.719991:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1782727906.719999:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+15:5803:x1869325572011008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727906.720010:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727906.720023:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56dd3cea00/0x22171c6c29614ded lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614de6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727906.720057:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56dd3cea00/0x22171c6c29614ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614de6 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727906.720067:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56dd3cea00/0x22171c6c29614ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614de6 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727906.720075:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3cea00, rc 0) 00000100:00100000:2.0:1782727906.720111:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:5803:x1869325572011008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727906.720118:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1782727906.720216:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572011008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727906.720229:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d57021c0600/0x22171c6c29614de6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614ded expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727906.720247:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d57021c0600/0x22171c6c29614de6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614ded expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727906.720294:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572011136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727906.720321:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727906.720547:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f9818780 going to sleep for 11 seconds 00000100:00100000:3.0:1782727906.720606:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572011136 00000100:00100000:3.0:1782727906.720610:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572011136 00000100:00100000:3.0:1782727906.720643:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1782727906.720650:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:5803:x1869325572011136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727906.721062:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:5803:x1869325572011136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 411us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727906.721069:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1782727906.721103:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572011136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727906.721137:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572011264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727906.722473:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727906.722564:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f9830e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782727906.725079:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572011264 00000100:00100000:2.0:1782727906.725091:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572011264 00000100:00100000:2.0:1782727906.725147:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1782727906.725156:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:5803:x1869325572011264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727906.725698:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:5803:x1869325572011264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 542us (3230us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727906.725706:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1782727906.725743:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572011264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727906.726136:0:8320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8320:1869325572011392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727906.726171:0:8320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727906.726205:0:8320:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f9818e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782727906.726595:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572011392 00000100:00100000:2.0:1782727906.726602:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572011392 00000100:00100000:3.0:1782727906.726681:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1782727906.726688:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:8320:x1869325572011392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727906.726974:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:8320:x1869325572011392:12345-0@lo:502:llog_process_th.0 Request processed in 287us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727906.726980:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1782727906.727047:0:8320:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8320:1869325572011392:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782727906.727068:0:8320:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782727906.727076:0:8320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727906.727078:0:8320:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782727906.727081:0:8320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1782727906.727100:0:8320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8320:1869325572011520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727906.727136:0:8320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727906.727167:0:8320:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f9818e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782727906.727972:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572011520 00000100:00100000:2.0:1782727906.727979:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572011520 00000100:00100000:2.0:1782727906.728029:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1782727906.728048:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:8320:x1869325572011520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727906.729718:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:8320:x1869325572011520:12345-0@lo:502:llog_process_th.0 Request processed in 1664us (2574us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727906.729731:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1782727906.731983:0:8320:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8320:1869325572011520:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782727906.732042:0:8320:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782727906.732054:0:8320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782727906.732056:0:8320:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782727906.732060:0:8320:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1782727906.732464:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1782727906.732489:0:5803:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782727906.732502:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d57021c0600/0x22171c6c29614de6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614ded expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727906.732618:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d57021c0600/0x22171c6c29614de6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614ded expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727906.732629:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782727906.732631:0:5803:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8d56c8fb6000 from 39 10000000:01000000:3.0:1782727906.732634:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782727906.732665:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d57021c1000/0x22171c6c29614df4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727906.732673:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d57021c1000/0x22171c6c29614df4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727906.732682:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d57021c1000/0x22171c6c29614df4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727906.732704:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572011648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782727906.732989:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727906.733137:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572011648 00000100:00100000:1.0:1782727906.733144:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572011648 00000100:00100000:1.0:1782727906.734447:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1782727906.734462:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:5803:x1869325572011648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727906.734478:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727906.734494:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56f94b1c00/0x22171c6c29614dfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614df4 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727906.734533:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56f94b1c00/0x22171c6c29614dfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614df4 expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727906.734560:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56f94b1c00/0x22171c6c29614dfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614df4 expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727906.734568:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f94b1c00, rc 0) 00000100:00100000:1.0:1782727906.734622:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:5803:x1869325572011648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727906.734629:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1782727906.734702:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f98303c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727906.734725:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572011648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727906.734741:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d57021c1000/0x22171c6c29614df4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614dfb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727906.734761:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d57021c1000/0x22171c6c29614df4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614dfb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727906.734900:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572011776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727906.734930:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727906.734949:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f98303c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727906.735024:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572011776 00000100:00100000:2.0:1782727906.735030:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572011776 00000100:00100000:2.0:1782727906.735071:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1782727906.735084:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:5803:x1869325572011776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727906.735370:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:5803:x1869325572011776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 292us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727906.735377:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1782727906.735479:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572011776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727906.735562:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572011904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727906.735600:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727906.735651:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f98303c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727906.735684:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572011904 00000100:00100000:1.0:1782727906.735689:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572011904 00000100:00100000:1.0:1782727906.735756:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1782727906.735763:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:5803:x1869325572011904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727906.735984:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:5803:x1869325572011904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 220us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727906.735991:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1782727906.736072:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572011904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727906.736868:0:8321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6efb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8321:1869325572012032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727906.736915:0:8321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727906.736941:0:8321:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f9830c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782727906.737488:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572012032 00000100:00100000:1.0:1782727906.737494:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572012032 00000100:00100000:1.0:1782727906.737588:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1782727906.737598:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:8321:x1869325572012032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727906.737845:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:8321:x1869325572012032:12345-0@lo:502:llog_process_th.0 Request processed in 248us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727906.737852:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1782727906.737881:0:8321:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6efb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8321:1869325572012032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727906.737929:0:8321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c743a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8321:1869325572012160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727906.737965:0:8321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727906.745148:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572012160 00000100:00100000:3.0:1782727906.745163:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572012160 00000100:00100000:3.0:1782727906.745219:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1782727906.745229:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:8321:x1869325572012160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727906.745570:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:8321:x1869325572012160:12345-0@lo:502:llog_process_th.0 Request processed in 340us (7602us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727906.745578:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1782727906.751255:0:8321:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d0f08780 going to sleep for 11 seconds 00000100:00100000:2.0:1782727906.751292:0:8321:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c743a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8321:1869325572012160:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1782727906.751854:0:8321:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1782727906.752177:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1782727906.752195:0:5803:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782727906.752207:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d57021c1000/0x22171c6c29614df4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614dfb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727906.752217:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d57021c1000/0x22171c6c29614df4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614dfb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727906.752227:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1782727906.752229:0:5803:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1782727906.752232:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1782727906.752264:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56c0031a00/0x22171c6c29614e02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727906.752272:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d56c0031a00/0x22171c6c29614e02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727906.752280:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d56c0031a00/0x22171c6c29614e02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727906.752302:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff74a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572012288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782727906.752688:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727906.752730:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c2ae4840 going to sleep for 11 seconds 00000100:00100000:3.0:1782727906.753419:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572012288 00000100:00100000:3.0:1782727906.753427:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572012288 00000100:00100000:3.0:1782727906.753483:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1782727906.753492:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:5803:x1869325572012288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727906.753505:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727906.753534:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56c1667600/0x22171c6c29614e09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614e02 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727906.753558:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56c1667600/0x22171c6c29614e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614e02 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727906.753568:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56c1667600/0x22171c6c29614e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614e02 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727906.753575:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56c1667600, rc 0) 00000100:00100000:3.0:1782727906.753628:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:5803:x1869325572012288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727906.753635:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1782727906.754553:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff74a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572012288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727906.754574:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d56c0031a00/0x22171c6c29614e02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614e09 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727906.754584:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d56c0031a00/0x22171c6c29614e02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614e09 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727906.754645:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff74a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572012416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727906.754684:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727906.754710:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c2ae4840 going to sleep for 11 seconds 00000100:00100000:2.0:1782727906.754839:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572012416 00000100:00100000:2.0:1782727906.754844:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572012416 00000100:00100000:2.0:1782727906.754886:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1782727906.754894:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:5803:x1869325572012416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727906.755491:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:5803:x1869325572012416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 596us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727906.755505:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1782727906.755866:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff74a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572012416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727906.755905:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff74a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572012544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727906.755946:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727906.755978:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c2ae4840 going to sleep for 11 seconds 00000100:00100000:0.0:1782727906.755993:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572012544 00000100:00100000:0.0:1782727906.755997:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572012544 00000100:00100000:0.0:1782727906.756031:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1782727906.756048:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:5803:x1869325572012544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727906.756871:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:5803:x1869325572012544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 822us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727906.756880:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1782727906.756967:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff74a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572012544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727906.764942:0:8322:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c743a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8322:1869325572012672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727906.765052:0:8322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727906.765097:0:8322:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d0f083c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727906.765234:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572012672 00000100:00100000:3.0:1782727906.765241:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572012672 00000100:00100000:3.0:1782727906.765291:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1782727906.765299:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:8322:x1869325572012672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727906.766595:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:8322:x1869325572012672:12345-0@lo:502:llog_process_th.0 Request processed in 1292us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727906.766607:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1782727906.766908:0:8322:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c743a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8322:1869325572012672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782727906.766942:0:8322:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782727906.766951:0:8322:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727906.766953:0:8322:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1782727906.766958:0:8322:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1782727906.766988:0:8322:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c743a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8322:1869325572012800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782727906.767031:0:8322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727906.767094:0:8322:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d0f083c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727906.767212:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572012800 00000100:00100000:3.0:1782727906.767218:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572012800 00000100:00100000:3.0:1782727906.767265:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1782727906.767274:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:8322:x1869325572012800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727906.767873:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:8322:x1869325572012800:12345-0@lo:502:llog_process_th.0 Request processed in 598us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727906.767882:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1782727906.767969:0:8322:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c743a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8322:1869325572012800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782727906.767989:0:8322:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782727906.767995:0:8322:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782727906.767996:0:8322:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1782727906.767999:0:8322:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1782727906.768194:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1782727906.768214:0:5803:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782727906.768224:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56c0031a00/0x22171c6c29614e02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614e09 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727906.768235:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d56c0031a00/0x22171c6c29614e02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614e09 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727906.768246:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1782727906.768248:0:5803:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8d56d0964d70 from 1 10000000:01000000:3.0:1782727906.768251:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782727906.768277:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56c1667400/0x22171c6c29614e10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727906.768285:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d56c1667400/0x22171c6c29614e10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727906.768295:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d56c1667400/0x22171c6c29614e10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727906.768310:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572012928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782727906.768407:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727906.768436:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f9830900 going to sleep for 11 seconds 00000100:00100000:2.0:1782727906.768474:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572012928 00000100:00100000:2.0:1782727906.768478:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572012928 00000100:00100000:2.0:1782727906.768537:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1782727906.768544:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:5803:x1869325572012928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727906.768553:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727906.768566:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56dd3cf600/0x22171c6c29614e17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614e10 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727906.768587:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56dd3cf600/0x22171c6c29614e17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614e10 expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727906.768604:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56dd3cf600/0x22171c6c29614e17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614e10 expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727906.768612:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3cf600, rc 0) 00000100:00100000:2.0:1782727906.768643:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:5803:x1869325572012928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727906.768648:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1782727906.768825:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572012928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727906.768844:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d56c1667400/0x22171c6c29614e10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614e17 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727906.768852:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d56c1667400/0x22171c6c29614e10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614e17 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727906.768893:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572013056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727906.768919:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727906.768944:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f9830900 going to sleep for 11 seconds 00000100:00100000:2.0:1782727906.769042:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572013056 00000100:00100000:2.0:1782727906.769047:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572013056 00000100:00100000:2.0:1782727906.769073:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1782727906.769089:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:5803:x1869325572013056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727906.769401:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:5803:x1869325572013056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 321us (480us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782727906.769408:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1782727906.770286:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572013056:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1782727906.770315:0:5803:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782727906.770388:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56c1667400/0x22171c6c29614e10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614e17 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727906.770409:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d56c1667400/0x22171c6c29614e10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614e17 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727907.309906:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727908.333814:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727908.975087:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869325572013568:0@lo:400:kworker.0 00000100:00100000:3.0:1782727908.975167:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727908.975236:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782727908.975244:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869325572013440:0@lo:400:kworker.0 00000100:00100000:3.0:1782727908.975267:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727908.975627:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572013184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727908.975662:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727908.975690:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572013696:0@lo:400:kworker.0 00000100:00100000:0.0:1782727908.975715:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727908.975734:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782727908.975741:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572013312:0@lo:400:kworker.0 00000100:00100000:0.0:1782727908.975770:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727908.975790:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869325572013824:0@lo:400:kworker.0 00000100:00100000:0.0:1782727908.975813:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727908.975844:0:8059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572013184 00000100:00100000:0.0:1782727908.975851:0:8059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572013184 00000100:00100000:0.0:1782727908.975904:0:8059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782727908.975913:0:8059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff749880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572013184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727908.975949:0:8059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782727908.975991:0:8059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff749880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572013184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727908.975998:0:8059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782727908.976036:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572013696 00000100:00100000:0.0:1782727908.976040:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572013696 00000100:00100000:0.0:1782727908.976066:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782727908.976073:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff74aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572013696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727908.976171:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572013952:0@lo:400:kworker.0 00000100:00100000:3.0:1782727908.976199:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727908.976224:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572013568 00000100:00100000:3.0:1782727908.976228:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572013568 00000100:00100000:3.0:1782727908.976260:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572013440 00000100:00100000:3.0:1782727908.976263:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572013440 00000100:00100000:3.0:1782727908.976274:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572013824 00000100:00100000:3.0:1782727908.976276:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572013824 00000100:00100000:2.0:1782727908.976562:0:6604:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1782727908.976572:0:6604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1782727908.976594:0:6607:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1782727908.976599:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572013952 00000100:00100000:2.0:1782727908.976603:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572013952 00000100:00100000:2.0:1782727908.976623:0:6607:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1782727908.976629:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782727908.976635:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572013952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727908.976678:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572013952:12345-0@lo:400:kworker.0 Request processed in 43us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727908.976685:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1782727908.976725:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ff6ec700 x1869325572013952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727908.976759:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572013952:0@lo:400:kworker.0 00000100:00080000:2.0:1782727908.976791:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782727908.976796:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782727908.976798:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727908.976809:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782727908.976817:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869325572013568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727908.976855:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869325572013568:12345-0@lo:400:kworker.0 Request processed in 39us (1689us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727908.976861:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782727908.976875:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782727908.976881:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869325572013440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727908.976908:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869325572013440:12345-0@lo:400:kworker.0 Request processed in 28us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727908.976914:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782727908.976925:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782727908.976931:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869325572013824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727908.976957:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869325572013824:12345-0@lo:400:kworker.0 Request processed in 26us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727908.976962:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782727908.976987:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869325572013440:0@lo:400:kworker.0 00000100:00100000:2.0:1782727908.976998:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869325572013568:0@lo:400:kworker.0 00000100:00100000:2.0:1782727908.977032:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572013312 00000100:00100000:2.0:1782727908.977036:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572013312 00000100:00100000:2.0:1782727908.977061:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1782727908.977088:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3316:x1869325572013312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727908.977120:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3316:x1869325572013312:12345-0@lo:400:kworker.0 Request processed in 46us (1350us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727908.977127:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1782727908.977180:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572013312:0@lo:400:kworker.0 00000100:00100000:2.0:1782727908.977191:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869325572013824:0@lo:400:kworker.0 00010000:00080000:2.0:1782727908.977202:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ff6ee300 x1869325572013184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727908.977218:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572013184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727908.978715:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff74aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572013696:12345-0@lo:400:kworker.0 Request processed in 2640us (2996us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727908.978723:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1782727908.979765:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ff6ef100 x1869325572013696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727908.979781:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572013696:0@lo:400:kworker.0 00010000:00010000:3.0:1782727909.357830:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727909.486124:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff74a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572014080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727909.486200:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727909.486621:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572014080 00000100:00100000:0.0:1782727909.486629:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572014080 00000100:00100000:0.0:1782727909.486689:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782727909.486698:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c743a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572014080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727909.486733:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782727909.486792:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c743a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572014080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727909.486799:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1782727909.486876:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ff74a680 x1869325572014080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727909.486895:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff74a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572014080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727909.601952:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727909.602065:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552063360 00000100:00100000:3.0:1782727909.602087:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552063360 00000100:00100000:3.0:1782727909.602150:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 165 00000100:00100000:3.0:1782727909.602162:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+8:5568:x1869325552063360:12345-192.168.202.31@tcp:101: 00010000:00010000:3.0:1782727909.602180:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727909.602228:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56c1666e00/0x22171c6c29614e1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x44e8af495f20a28 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727909.602261:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56c1666e00/0x22171c6c29614e1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a28 expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727909.602272:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56c1666e00/0x22171c6c29614e1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a28 expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727909.602282:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56c1666e00, rc 0) 00000100:00100000:3.0:1782727909.602353:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+9:5568:x1869325552063360:12345-192.168.202.31@tcp:101: Request processed in 195us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727909.602361:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 165 00000100:00100000:1.0:1782727909.610994:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727909.611183:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552063488 00000100:00100000:3.0:1782727909.611194:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552063488 00000100:00100000:3.0:1782727909.611267:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 166 00000100:00100000:3.0:1782727909.611278:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+9:5568:x1869325552063488:12345-192.168.202.31@tcp:501: 00000100:00100000:3.0:1782727909.611935:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+9:5568:x1869325552063488:12345-192.168.202.31@tcp:501: Request processed in 657us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727909.611945:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 166 00000100:00100000:1.0:1782727909.619733:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727909.620129:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552063616 00000100:00100000:2.0:1782727909.620140:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552063616 00000100:00100000:2.0:1782727909.620193:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 167 00000100:00100000:2.0:1782727909.620205:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0877050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+9:5568:x1869325552063616:12345-192.168.202.31@tcp:503: 00000100:00100000:2.0:1782727909.620805:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0877050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+9:5568:x1869325552063616:12345-192.168.202.31@tcp:503: Request processed in 600us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727909.620822:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 167 00000100:00100000:1.0:1782727909.627460:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727909.632603:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552063744 00000100:00100000:3.0:1782727909.632618:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552063744 00000100:00100000:3.0:1782727909.632703:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 168 00000100:00100000:3.0:1782727909.632714:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0875c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+9:6053:x1869325552063744:12345-192.168.202.31@tcp:502: 00000100:00100000:3.0:1782727909.633029:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0875c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+9:6053:x1869325552063744:12345-192.168.202.31@tcp:502: Request processed in 316us (5578us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727909.633038:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 168 00000100:00100000:1.0:1782727909.638147:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782727909.638264:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552063872 00000100:00100000:0.0:1782727909.638274:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552063872 00000100:00100000:0.0:1782727909.638345:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 169 00000100:00100000:0.0:1782727909.638354:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0876050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+9:6053:x1869325552063872:12345-192.168.202.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782727909.638679:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0876050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+9:6053:x1869325552063872:12345-192.168.202.31@tcp:502:llog_process_th.0 Request processed in 325us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727909.638687:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 169 00000100:00100000:1.0:1782727909.652100:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727909.652437:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552064000 00000100:00100000:2.0:1782727909.652447:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552064000 00000100:00100000:2.0:1782727909.652550:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 170 00000100:00100000:2.0:1782727909.652561:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+9:5568:x1869325552064000:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727909.652578:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727909.652595:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56dd3cfc00/0x22171c6c29614e25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x44e8af495f20a2f expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727909.652624:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56dd3cfc00/0x22171c6c29614e25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a2f expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727909.652635:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56dd3cfc00/0x22171c6c29614e25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a2f expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727909.652643:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3cfc00, rc 0) 00000100:00100000:2.0:1782727909.652695:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+10:5568:x1869325552064000:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 Request processed in 136us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727909.652702:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 170 00000100:00100000:1.0:1782727909.661747:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727909.662148:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552064128 00000100:00100000:2.0:1782727909.662159:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552064128 00000100:00100000:2.0:1782727909.662288:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 171 00000100:00100000:2.0:1782727909.662300:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+10:5568:x1869325552064128:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727909.662637:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+10:5568:x1869325552064128:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 Request processed in 338us (898us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782727909.662645:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 171 00010000:00010000:2.0:1782727910.385528:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727910.629383:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727910.629432:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727910.629464:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727910.629491:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727910.629550:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552064640 00000100:00100000:1.0:1782727910.629559:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552064640 00000100:00100000:1.0:1782727910.629615:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552064512 00000100:00100000:1.0:1782727910.629619:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552064512 00000100:00100000:1.0:1782727910.629643:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 11 00000100:00100000:1.0:1782727910.629653:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2352:x1869325552064640:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782727910.629717:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2352:x1869325552064640:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 66us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727910.629723:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 11 00000100:00100000:1.0:1782727910.629738:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 12 00000100:00100000:1.0:1782727910.629743:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2352:x1869325552064512:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782727910.629761:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2352:x1869325552064512:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 18us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727910.629766:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 12 00000100:00100000:1.0:1782727910.629781:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552064256 00000100:00100000:1.0:1782727910.629784:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552064256 00000100:00100000:1.0:1782727910.629803:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 172 00000100:00100000:1.0:1782727910.629808:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0874c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2352:x1869325552064256:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782727910.629828:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0874c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2352:x1869325552064256:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 20us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727910.629840:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 172 00000100:00080000:1.0:1782727910.629865:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782727910.629868:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782727910.630129:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552064384 00000100:00100000:3.0:1782727910.630139:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552064384 00000100:00100000:3.0:1782727910.630174:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 31 00000100:00100000:3.0:1782727910.630179:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2352:x1869325552064384:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782727910.630209:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2352:x1869325552064384:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 30us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727910.630214:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 31 00000100:00080000:1.0:1782727910.631080:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1782727910.737710:0:8361:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff5bf51ab0 20000000:00000080:1.0:1782727910.737727:0:8361:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d56f994c400 uarg=0000000000000000 20000000:01000000:1.0:1782727910.737768:0:8361:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782727910.737774:0:8361:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782727910.737779:0:8361:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1782727910.741564:0:8362:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1782727910.741954:0:8361:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1782727910.751333:0:8361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1782727910.751392:0:8361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1782727910.751446:0:8361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1782727910.751464:0:8361:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782727910.751482:0:8361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e2c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727910.751502:0:8361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d56dd3cf400/0x22171c6c29614bf5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614bee expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727910.751689:0:8361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d56c1666800/0x22171c6c29614c73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614c6c expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727910.751699:0:8361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614cce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614cc7 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727910.751709:0:8361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d56f94b0a00/0x22171c6c29614d8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f209f7 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727910.751718:0:8361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e2c lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727910.751759:0:8361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d56f94b0a00/0x22171c6c29614d8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f209f7 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727910.751776:0:8361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d56f94b0a00/0x22171c6c29614d8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f209f7 expref: 9 pid: 5801 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727910.751791:0:8361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c7439c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8361:1869325572014208:192.168.202.31@tcp:104: 00010000:00010000:2.0:1782727910.752197:0:8361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614cce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22171c6c29614cc7 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727910.752207:0:8361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614cce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22171c6c29614cc7 expref: 18 pid: 5801 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727910.752217:0:8361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c7438000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8361:1869325572014336:0@lo:104: 00000100:00100000:2.0:1782727910.752258:0:8361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782727910.752291:0:8361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d56c1666800/0x22171c6c29614c73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22171c6c29614c6c expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727910.752299:0:8361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d56c1666800/0x22171c6c29614c73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22171c6c29614c6c expref: 18 pid: 5800 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727910.752307:0:8361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c743b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8361:1869325572014464:0@lo:104: 00000100:00100000:2.0:1782727910.752333:0:8361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782727910.752399:0:8361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d56dd3cf400/0x22171c6c29614bf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22171c6c29614bee expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727910.752408:0:8361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d56dd3cf400/0x22171c6c29614bf5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22171c6c29614bee expref: 18 pid: 5798 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727910.752417:0:8361:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c743b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8361:1869325572014592:0@lo:104: 00000100:00100000:2.0:1782727910.752436:0:8361:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f44b6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782727910.755364:0:5790:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782727910.755409:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727910.755432:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572014336 00000100:00100000:3.0:1782727910.755440:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572014336 00000100:00100000:3.0:1782727910.755481:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572014464 00000100:00100000:3.0:1782727910.755484:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572014464 00000100:00100000:3.0:1782727910.755493:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572014592 00000100:00100000:3.0:1782727910.755495:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572014592 00000100:00100000:3.0:1782727910.755532:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782727910.755542:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c7439f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+5:8361:x1869325572014336:12345-0@lo:104: 00010000:00010000:3.0:1782727910.755558:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8200/0x22171c6c29614cc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614cce expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.755629:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782727910.755635:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c7439f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+5:8361:x1869325572014336:12345-0@lo:104: Request processed in 96us (3378us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727910.755643:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782727910.755660:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782727910.755665:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d5700c00850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+4:8361:x1869325572014464:12345-0@lo:104: 00010000:00010000:3.0:1782727910.755673:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8d56c1666a00/0x22171c6c29614c6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614c73 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.755715:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782727910.755736:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d5700c00850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+4:8361:x1869325572014464:12345-0@lo:104: Request processed in 71us (3403us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727910.755742:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782727910.755773:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782727910.755780:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+3:8361:x1869325572014592:12345-0@lo:104: 00010000:00010000:3.0:1782727910.755786:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9800/0x22171c6c29614bee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614bf5 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.755821:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782727910.755825:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+3:8361:x1869325572014592:12345-0@lo:104: Request processed in 47us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727910.755831:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1782727910.755851:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782727910.755857:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8200/0x22171c6c29614cc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614cce expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.755865:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56cc3d8200 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:3.0:1782727910.755869:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8200/0x22171c6c29614cc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x22171c6c29614cce expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.755876:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8200/0x22171c6c29614cc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x22171c6c29614cce expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727910.755884:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8200/0x22171c6c29614cc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x22171c6c29614cce expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727910.755889:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782727910.755922:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8200/0x22171c6c29614cc7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614cce expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.755938:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727910.755961:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8200/0x22171c6c29614cc7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614cce expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.755968:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d8200/0x22171c6c29614cc7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614cce expref: -99 pid: 7482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.755983:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782727910.755986:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8d56c1666a00/0x22171c6c29614c6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614c73 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.755992:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56c1666a00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:3.0:1782727910.755994:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8d56c1666a00/0x22171c6c29614c6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x22171c6c29614c73 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.756011:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8d56c1666a00/0x22171c6c29614c6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x22171c6c29614c73 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727910.756016:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8d56c1666a00/0x22171c6c29614c6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x22171c6c29614c73 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727910.756021:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782727910.756033:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8d56c1666a00/0x22171c6c29614c6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614c73 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.756037:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727910.756043:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8d56c1666a00/0x22171c6c29614c6c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614c73 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.756048:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8d56c1666a00/0x22171c6c29614c6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614c73 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.756063:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727910.756065:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9800/0x22171c6c29614bee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614bf5 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.756070:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56cc3d9800 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:3.0:1782727910.756072:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9800/0x22171c6c29614bee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x22171c6c29614bf5 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.756078:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9800/0x22171c6c29614bee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x22171c6c29614bf5 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782727910.756084:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9800/0x22171c6c29614bee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x22171c6c29614bf5 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782727910.756088:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782727910.756098:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9800/0x22171c6c29614bee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614bf5 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.756103:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782727910.756116:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9800/0x22171c6c29614bee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614bf5 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.756122:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8d56cc3d9800/0x22171c6c29614bee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614bf5 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.756133:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727910.756135:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727910.756137:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727910.756150:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572014720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782727910.756186:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727910.756216:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727910.756220:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572014848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782727910.756235:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727910.756253:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572014976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782727910.756269:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727910.756294:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572014720 00000100:00100000:3.0:1782727910.756298:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572014720 00010000:00010000:3.0:1782727910.756314:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614cce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614cc7 expref: 19 pid: 5801 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727910.756331:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572014848 00000100:00100000:3.0:1782727910.756333:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572014848 00010000:00010000:3.0:1782727910.756340:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d56c1666800/0x22171c6c29614c73 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614c6c expref: 20 pid: 5800 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727910.756347:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572014976 00000100:00100000:3.0:1782727910.756349:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572014976 00010000:00010000:3.0:1782727910.756355:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d56dd3cf400/0x22171c6c29614bf5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614bee expref: 21 pid: 5798 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727910.756364:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782727910.756368:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+21:3316:x1869325572014720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782727910.756377:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727910.756381:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614cce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614cc7 expref: 21 pid: 5801 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.756388:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614cce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22171c6c29614cc7 expref: 21 pid: 5801 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.756410:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727910.756437:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+21:3316:x1869325572014720:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727910.756444:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782727910.756457:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782727910.756462:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+20:3316:x1869325572014848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782727910.756469:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727910.756473:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d56c1666800/0x22171c6c29614c73 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614c6c expref: 20 pid: 5800 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.756481:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d56c1666800/0x22171c6c29614c73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22171c6c29614c6c expref: 20 pid: 5800 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.756490:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727910.756547:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+20:3316:x1869325572014848:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727910.756554:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782727910.756566:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782727910.756572:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3314:x1869325572014976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782727910.756579:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727910.756583:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d56dd3cf400/0x22171c6c29614bf5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614bee expref: 19 pid: 5798 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.756590:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d56dd3cf400/0x22171c6c29614bf5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22171c6c29614bee expref: 19 pid: 5798 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.756598:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727910.756629:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3314:x1869325572014976:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727910.756636:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782727910.756669:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572014976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782727910.756692:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572014848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782727910.756698:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572014720:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782727910.757127:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727910.757276:0:8361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56c0030e00/0x22171c6c29614cce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22171c6c29614cc7 expref: 18 pid: 5801 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727910.757301:0:8361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c7438000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8361:1869325572014336:0@lo:104: 00010000:00010000:2.0:1782727910.757312:0:8361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56c1666800/0x22171c6c29614c73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22171c6c29614c6c expref: 17 pid: 5800 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727910.757328:0:8361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c743b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8361:1869325572014464:0@lo:104: 00010000:00010000:2.0:1782727910.757339:0:8361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56dd3cf400/0x22171c6c29614bf5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22171c6c29614bee expref: 16 pid: 5798 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727910.757347:0:8361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c743b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8361:1869325572014592:0@lo:104: 00010000:00010000:0.0:1782727910.757597:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727910.771777:0:8361:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c7439c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8361:1869325572014208:192.168.202.31@tcp:104: 00010000:00010000:2.0:1782727910.771820:0:8361:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e2c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727910.782679:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727910.782776:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552064768 00000100:00100000:3.0:1782727910.782786:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552064768 00010000:00010000:3.0:1782727910.782827:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d56f94b0a00/0x22171c6c29614d8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f209f7 expref: 10 pid: 5801 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727910.782864:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24 00000100:00100000:3.0:1782727910.782873:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b661aafc-708f-4f38-b71b-eec242d406b4+10:2352:x1869325552064768:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782727910.782887:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727910.782892:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d56f94b0a00/0x22171c6c29614d8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f209f7 expref: 10 pid: 5801 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.782905:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d56f94b0a00/0x22171c6c29614d8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f209f7 expref: 10 pid: 5801 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.782924:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56f94b0a00/0x22171c6c29614d8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f209f7 expref: 10 pid: 5801 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.782942:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e2c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.783014:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e2c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.783044:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e2c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.783050:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e2c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.783056:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e2c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.783063:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e2c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.783068:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3ce800 already unused, calling callback (ffffffffc152fcf0) 00010000:00010000:3.0:1782727910.783073:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e2c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.783081:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e2c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.783105:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e2c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727910.783115:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727910.783174:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f55e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b661aafc-708f-4f38-b71b-eec242d406b4+9:2352:x1869325552064768:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 301us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727910.783182:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24 00010000:00010000:2.0:1782727910.783260:0:8361:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e2c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727910.783268:0:8361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e2c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727910.783274:0:8361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e2c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727911.285627:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727911.288656:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552064896 00000100:00100000:2.0:1782727911.288745:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552064896 00000100:00100000:2.0:1782727911.288835:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 173 00000100:00100000:2.0:1782727911.288846:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0874850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+9:5568:x1869325552064896:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727911.288864:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727911.289390:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44e8af495f20a36 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727911.289423:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a36 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727911.289452:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a36 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727911.289461:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3ce800, rc 0) 00000100:00100000:2.0:1782727911.289687:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0874850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+10:5568:x1869325552064896:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 Request processed in 841us (4068us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727911.289695:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 173 00000100:00100000:1.0:1782727911.311953:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782727911.312120:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552065024 00000100:00100000:0.0:1782727911.312130:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552065024 00000100:00100000:0.0:1782727911.312191:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 174 00000100:00100000:0.0:1782727911.312202:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+10:5568:x1869325552065024:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727911.312540:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+10:5568:x1869325552065024:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 Request processed in 338us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727911.312548:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 174 00000100:00100000:1.0:1782727911.316107:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727911.316268:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552065152 00000100:00100000:2.0:1782727911.316280:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552065152 00000100:00100000:2.0:1782727911.316350:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 175 00000100:00100000:2.0:1782727911.316360:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0874050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+10:5568:x1869325552065152:12345-192.168.202.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727911.316880:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0874050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+10:5568:x1869325552065152:12345-192.168.202.31@tcp:503:ll_cfg_requeue.0 Request processed in 519us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727911.316889:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 175 00000100:00100000:2.0:1782727911.338386:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727911.338817:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552065280 00000100:00100000:1.0:1782727911.338828:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552065280 00000100:00100000:1.0:1782727911.338897:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 176 00000100:00100000:1.0:1782727911.338908:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0874450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:6104:x1869325552065280:12345-192.168.202.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782727911.339176:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0874450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:6104:x1869325552065280:12345-192.168.202.31@tcp:502:llog_process_th.0 Request processed in 268us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727911.339186:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 176 00000100:00100000:1.0:1782727911.347577:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782727911.347686:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552065408 00000100:00100000:0.0:1782727911.347695:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552065408 00000100:00100000:0.0:1782727911.347754:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 177 00000100:00100000:0.0:1782727911.347764:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+10:6104:x1869325552065408:12345-192.168.202.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782727911.348045:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+10:6104:x1869325552065408:12345-192.168.202.31@tcp:502:llog_process_th.0 Request processed in 281us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727911.348053:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 177 00010000:00010000:2.0:1782727911.407166:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782727912.186312:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782727912.186320:0:5803:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8d56d9e79800 from 4 10000000:01000000:1.0:1782727912.186325:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782727912.186371:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0800/0x22171c6c29614e3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727912.186398:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0800/0x22171c6c29614e3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727912.186411:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0800/0x22171c6c29614e3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727912.186438:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572015104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782727912.186552:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727912.186610:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c33ac600 going to sleep for 11 seconds 00000100:00100000:3.0:1782727912.186825:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572015104 00000100:00100000:3.0:1782727912.186833:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572015104 00000100:00100000:3.0:1782727912.186880:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1782727912.186889:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0875850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:5803:x1869325572015104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727912.186921:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727912.186942:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56c1666a00/0x22171c6c29614e41 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614e3a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727912.186965:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56c1666a00/0x22171c6c29614e41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614e3a expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727912.186975:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56c1666a00/0x22171c6c29614e41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614e3a expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727912.186983:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56c1666a00, rc 0) 00000100:00100000:3.0:1782727912.187041:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0875850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:5803:x1869325572015104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727912.187048:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1782727912.187346:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572015104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727912.187362:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0800/0x22171c6c29614e3a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614e41 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727912.187370:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0800/0x22171c6c29614e3a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614e41 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727912.187425:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572015232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727912.187452:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727912.187548:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c33ac600 going to sleep for 11 seconds 00000100:00100000:0.0:1782727912.195399:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572015232 00000100:00100000:0.0:1782727912.195415:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572015232 00000100:00100000:0.0:1782727912.195547:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1782727912.195558:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0875450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:5803:x1869325572015232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727912.195876:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0875450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:5803:x1869325572015232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 319us (8421us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727912.195884:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1782727912.196004:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572015232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727912.196055:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572015360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727912.196098:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727912.201300:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c33ac600 going to sleep for 11 seconds 00000100:00100000:3.0:1782727912.207091:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572015360 00000100:00100000:3.0:1782727912.207108:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572015360 00000100:00100000:2.0:1782727912.212891:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1782727912.212917:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:5803:x1869325572015360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727912.213381:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:5803:x1869325572015360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 475us (17279us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727912.213390:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1782727912.219869:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572015360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727912.225553:0:8391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6ece00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8391:1869325572015488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727912.225652:0:8391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727912.225706:0:8391:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d826e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727912.226609:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572015488 00000100:00100000:1.0:1782727912.226631:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572015488 00000100:00100000:1.0:1782727912.226691:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1782727912.226701:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0876450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:8391:x1869325572015488:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727912.226970:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0876450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:8391:x1869325572015488:12345-0@lo:502:llog_process_th.0 Request processed in 270us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727912.226979:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1782727912.227271:0:8391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6ece00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8391:1869325572015488:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782727912.227318:0:8391:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782727912.227328:0:8391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727912.227330:0:8391:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782727912.227338:0:8391:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d56d9e79800 00000020:00000080:3.0:1782727912.227341:0:8391:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782727912.227452:0:8391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6ece00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8391:1869325572015616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727912.227495:0:8391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727912.227579:0:8391:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d826e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727912.234130:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572015616 00000100:00100000:0.0:1782727912.234147:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572015616 00000100:00100000:0.0:1782727912.234219:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1782727912.234229:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0875050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:8391:x1869325572015616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727912.234540:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0875050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:8391:x1869325572015616:12345-0@lo:502:llog_process_th.0 Request processed in 311us (7044us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727912.234549:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1782727912.234817:0:8391:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6ece00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8391:1869325572015616:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782727912.234852:0:8391:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727912.234861:0:8391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727912.234863:0:8391:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1782727912.234868:0:8391:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1782727912.237432:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1782727912.237474:0:5803:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782727912.237487:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0800/0x22171c6c29614e3a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614e41 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727912.237500:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0800/0x22171c6c29614e3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614e41 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727912.237533:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782727912.237536:0:5803:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8d56c75cf800 from 4 10000000:01000000:1.0:1782727912.237538:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782727912.237575:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56f94b1800/0x22171c6c29614e48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727912.237583:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d56f94b1800/0x22171c6c29614e48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727912.237593:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d56f94b1800/0x22171c6c29614e48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727912.237617:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572015744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782727912.237684:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727912.237743:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c33ac9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727912.237768:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572015744 00000100:00100000:1.0:1782727912.237784:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572015744 00000100:00100000:1.0:1782727912.237838:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1782727912.237847:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:5803:x1869325572015744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727912.237860:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727912.237873:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56f94b1200/0x22171c6c29614e4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614e48 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727912.237896:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56f94b1200/0x22171c6c29614e4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614e48 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727912.237920:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56f94b1200/0x22171c6c29614e4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614e48 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727912.237929:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f94b1200, rc 0) 00000100:00100000:1.0:1782727912.241654:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:5803:x1869325572015744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3797us (3959us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727912.241668:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1782727912.241731:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572015744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727912.241753:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d56f94b1800/0x22171c6c29614e48 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614e4f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727912.241766:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d56f94b1800/0x22171c6c29614e48 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614e4f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727912.241836:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572015872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727912.241869:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727912.241899:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c33ac9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727912.241976:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572015872 00000100:00100000:0.0:1782727912.241983:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572015872 00000100:00100000:0.0:1782727912.242028:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1782727912.242037:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:5803:x1869325572015872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727912.242254:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:5803:x1869325572015872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 218us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727912.242261:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1782727912.244750:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572015872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727912.244816:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572016000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727912.244878:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727912.246252:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c33ac9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727912.262474:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572016000 00000100:00100000:0.0:1782727912.262493:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572016000 00000100:00100000:0.0:1782727912.262619:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1782727912.262630:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:5803:x1869325572016000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727912.263174:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:5803:x1869325572016000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 545us (18294us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727912.263185:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1782727912.263246:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572016000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727912.293294:0:8395:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6eea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8395:1869325572016128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727912.293390:0:8395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727912.293440:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572016128 00000100:00100000:3.0:1782727912.293450:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572016128 00000100:00100000:3.0:1782727912.293496:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1782727912.293505:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:8395:x1869325572016128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727912.293739:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:8395:x1869325572016128:12345-0@lo:502:llog_process_th.0 Request processed in 234us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727912.293747:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1782727912.293794:0:8395:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d9f163c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727912.293812:0:8395:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6eea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8395:1869325572016128:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782727912.293838:0:8395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782727912.293847:0:8395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782727912.293849:0:8395:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782727912.293855:0:8395:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d56c75cf800 00000020:00000080:3.0:1782727912.293857:0:8395:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782727912.293925:0:8395:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6eea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8395:1869325572016256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782727912.299128:0:8395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727912.299191:0:8395:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d9f163c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782727912.303108:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572016256 00000100:00100000:1.0:1782727912.303122:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572016256 00000100:00100000:1.0:1782727912.303178:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1782727912.303189:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:8395:x1869325572016256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782727912.307170:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:8395:x1869325572016256:12345-0@lo:502:llog_process_th.0 Request processed in 3973us (8040us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727912.307185:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1782727912.308454:0:8395:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6eea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8395:1869325572016256:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782727912.308498:0:8395:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727912.308524:0:8395:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727912.308527:0:8395:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1782727912.308533:0:8395:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1782727912.309102:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1782727912.309131:0:5803:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782727912.309142:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56f94b1800/0x22171c6c29614e48 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614e4f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727912.309154:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d56f94b1800/0x22171c6c29614e48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614e4f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782727912.309165:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782727912.309168:0:5803:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8d56c8fb6000 from 4 10000000:01000000:1.0:1782727912.309171:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782727912.309205:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0e00/0x22171c6c29614e56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727912.309213:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0e00/0x22171c6c29614e56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727912.309224:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0e00/0x22171c6c29614e56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727912.309256:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572016384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782727912.312478:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727912.312541:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c33ace40 going to sleep for 11 seconds 00000100:00100000:2.0:1782727912.313072:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572016384 00000100:00100000:2.0:1782727912.313082:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572016384 00000100:00100000:2.0:1782727912.313141:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1782727912.313151:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:5803:x1869325572016384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727912.313174:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727912.313192:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56dd3cec00/0x22171c6c29614e5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614e56 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727912.313220:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56dd3cec00/0x22171c6c29614e5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614e56 expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727912.313232:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56dd3cec00/0x22171c6c29614e5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614e56 expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727912.313242:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3cec00, rc 0) 00000100:00100000:2.0:1782727912.314081:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:5803:x1869325572016384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 927us (1606us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727912.314089:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1782727912.316120:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572016384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727912.316148:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0e00/0x22171c6c29614e56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614e5d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727912.316160:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0e00/0x22171c6c29614e56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614e5d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727912.316241:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572016512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782727912.316313:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727912.316361:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c33ace40 going to sleep for 11 seconds 00000100:00100000:0.0:1782727912.318218:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572016512 00000100:00100000:0.0:1782727912.318230:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572016512 00000100:00100000:0.0:1782727912.319687:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1782727912.319708:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:5803:x1869325572016512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727912.321037:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:5803:x1869325572016512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1332us (4719us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727912.321059:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1782727912.324243:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572016512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727912.324314:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572016640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727912.324396:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727912.324436:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d0f08e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782727912.324460:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572016640 00000100:00100000:3.0:1782727912.324465:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572016640 00000100:00100000:3.0:1782727912.324528:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1782727912.324544:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:5803:x1869325572016640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727912.324732:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:5803:x1869325572016640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727912.324740:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1782727912.324785:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572016640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727912.328472:0:8398:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff74ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8398:1869325572016768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727912.328613:0:8398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727912.328651:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572016768 00000100:00100000:0.0:1782727912.328656:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572016768 00000100:00100000:0.0:1782727912.328701:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1782727912.328710:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:8398:x1869325572016768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727912.328913:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0850850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:8398:x1869325572016768:12345-0@lo:502:llog_process_th.0 Request processed in 203us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727912.328922:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1782727912.328969:0:8398:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d826e480 going to sleep for 11 seconds 00000100:00100000:0.0:1782727912.329002:0:8398:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff74ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8398:1869325572016768:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782727912.329029:0:8398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782727912.329040:0:8398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727912.329042:0:8398:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782727912.329049:0:8398:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d56c8fb6000 00000020:00000080:0.0:1782727912.329051:0:8398:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1782727912.329531:0:8398:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff74ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8398:1869325572016896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727912.329573:0:8398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727912.329593:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572016896 00000100:00100000:0.0:1782727912.329597:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572016896 00000100:00100000:0.0:1782727912.329618:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1782727912.329625:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:8398:x1869325572016896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782727912.329747:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:8398:x1869325572016896:12345-0@lo:502:llog_process_th.0 Request processed in 121us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727912.329762:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1782727912.329791:0:8398:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f98103c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727912.329805:0:8398:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff74ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:8398:1869325572016896:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782727912.329824:0:8398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782727912.329829:0:8398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782727912.329830:0:8398:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1782727912.329834:0:8398:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1782727912.330047:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1782727912.330073:0:5803:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782727912.330082:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0e00/0x22171c6c29614e56 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614e5d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727912.330093:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0e00/0x22171c6c29614e56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614e5d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727912.437596:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727913.453740:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727914.093810:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f95ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869325572017280:0@lo:400:kworker.0 00000100:00100000:1.0:1782727914.093896:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727914.093961:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782727914.093966:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f95aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869325572017152:0@lo:400:kworker.0 00000100:00100000:1.0:1782727914.093998:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727914.094013:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f95ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572017664:0@lo:400:kworker.0 00000100:00100000:1.0:1782727914.094033:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727914.094068:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572017280 00000100:00100000:1.0:1782727914.094075:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572017280 00000100:00100000:1.0:1782727914.094131:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572017152 00000100:00100000:1.0:1782727914.094134:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572017152 00000100:00100000:1.0:1782727914.094181:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782727914.094190:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f95adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869325572017280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727914.094251:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f95adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869325572017280:12345-0@lo:400:kworker.0 Request processed in 62us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727914.094259:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782727914.094566:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3315:1869325572017024:0@lo:400:kworker.0 00000100:00100000:3.0:1782727914.094607:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727914.094638:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f95ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869325572017536:0@lo:400:kworker.0 00000100:00100000:3.0:1782727914.094661:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727914.094674:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782727914.094678:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f95afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572017408:0@lo:400:kworker.0 00000100:00100000:3.0:1782727914.094701:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727914.094731:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572017536 00000100:00100000:3.0:1782727914.094734:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572017536 00000100:00100000:3.0:1782727914.102579:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782727914.102606:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f95ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869325572017152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727914.102711:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f95ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869325572017152:12345-0@lo:400:kworker.0 Request processed in 119us (8712us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727914.102736:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782727914.102759:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782727914.102768:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869325572017536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727914.102812:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869325572017536:12345-0@lo:400:kworker.0 Request processed in 46us (8149us total) trans 0 rc 0/0 00000100:00080000:0.0:1782727914.103412:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727914.103433:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572017664 00000100:00100000:0.0:1782727914.103441:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572017664 00000100:00100000:0.0:1782727914.103622:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572017408 00000100:00100000:0.0:1782727914.103627:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572017408 00000100:00100000:0.0:1782727914.103654:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782727914.103660:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f95adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572017664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727914.103709:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f95adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572017664:12345-0@lo:400:kworker.0 Request processed in 50us (9675us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727914.103715:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782727914.103728:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782727914.103734:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572017408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727914.103763:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572017408:12345-0@lo:400:kworker.0 Request processed in 30us (9061us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727914.103768:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1782727914.103781:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782727914.103784:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727914.104056:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f95aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869325572017152:0@lo:400:kworker.0 00010000:00080000:0.0:1782727914.104076:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f95ae300 x1869325572017664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727914.104104:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f95ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572017664:0@lo:400:kworker.0 00000100:00100000:0.0:1782727914.104118:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f95ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869325572017280:0@lo:400:kworker.0 00010000:00080000:0.0:1782727914.104243:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f95afb80 x1869325572017408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727914.104253:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f95afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572017408:0@lo:400:kworker.0 00000100:00100000:3.0:1782727914.104351:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782727914.106098:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f95ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869325572017536:0@lo:400:kworker.0 00000100:00100000:2.0:1782727914.106652:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572017024 00000100:00100000:2.0:1782727914.106661:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572017024 00000100:00100000:2.0:1782727914.107004:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1782727914.107014:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3315:x1869325572017024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727914.107102:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3315:x1869325572017024:12345-0@lo:400:kworker.0 Request processed in 90us (12494us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727914.107110:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1782727914.107650:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff74ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572017792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727914.107699:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727914.108051:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572017792 00000100:00100000:0.0:1782727914.108058:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572017792 00000100:00100000:0.0:1782727914.108095:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782727914.108103:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572017792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727914.108137:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782727914.116784:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3315:1869325572017024:0@lo:400:kworker.0 00000100:00100000:0.0:1782727914.130654:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572017792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 22539us (22942us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727914.130671:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1782727914.135411:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ff74ad80 x1869325572017792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727914.135446:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff74ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572017792:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782727914.478716:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727914.605866:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782727914.605889:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572017920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727914.605958:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727914.607459:0:8059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572017920 00000100:00100000:1.0:1782727914.607482:0:8059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572017920 00000100:00100000:1.0:1782727914.607567:0:8059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782727914.607578:0:8059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572017920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727914.607621:0:8059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782727914.607703:0:8059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572017920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (1745us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727914.607709:0:8059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1782727914.607915:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ff748380 x1869325572017920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727914.607934:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572017920:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782727915.502291:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727915.744633:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727915.744685:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727915.744711:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782727915.744921:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552065536 00000100:00100000:0.0:1782727915.744933:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552065536 00000100:00100000:0.0:1782727915.745024:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 194 00000100:00100000:0.0:1782727915.745035:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2352:x1869325552065536:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782727915.745751:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552065792 00000100:00100000:1.0:1782727915.745758:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552065792 00000100:00100000:1.0:1782727915.745826:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 15 00000100:00100000:1.0:1782727915.745834:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2352:x1869325552065792:12345-192.168.202.31@tcp:400:kworker.0 00000100:00080000:2.0:1782727915.745895:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727915.746270:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2352:x1869325552065536:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 1234us (1648us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727915.746282:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 194 00000100:00100000:3.0:1782727915.746412:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727915.750474:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552065664 00000100:00100000:3.0:1782727915.750494:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552065664 00000100:00100000:3.0:1782727915.750614:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 35 00000100:00100000:3.0:1782727915.750628:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2352:x1869325552065664:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782727915.750742:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2352:x1869325552065664:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 116us (6028us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727915.750773:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 35 00000100:00100000:3.0:1782727915.750805:0:8323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552065920 00000100:00100000:3.0:1782727915.750809:0:8323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552065920 00000100:00100000:3.0:1782727915.750839:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 16 00000100:00100000:3.0:1782727915.750845:0:8323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2352:x1869325552065920:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782727915.750878:0:8323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2352:x1869325552065920:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 33us (4467us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727915.750885:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 16 00000100:00100000:1.0:1782727915.751969:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2352:x1869325552065792:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 6119us (7265us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727915.751980:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 15 00000100:00080000:2.0:1782727915.752644:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782727915.752652:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782727916.526111:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727917.552465:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727918.583347:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727919.215310:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572018048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727919.215418:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727919.215873:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572018048 00000100:00100000:0.0:1782727919.215885:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572018048 00000100:00100000:0.0:1782727919.215972:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782727919.215984:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572018048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727919.216038:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782727919.216106:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572018048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727919.216115:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1782727919.216266:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ff6edc00 x1869325572018048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727919.216290:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572018048:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782727919.216443:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727919.216913:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869325572018432:0@lo:400:kworker.0 00000100:00100000:3.0:1782727919.216972:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727919.217001:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782727919.217007:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869325572018560:0@lo:400:kworker.0 00000100:00100000:3.0:1782727919.217030:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727919.218577:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869325572018304:0@lo:400:kworker.0 00000100:00100000:2.0:1782727919.218651:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727919.218699:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782727919.218707:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3317:1869325572018176:0@lo:400:kworker.0 00000100:00100000:2.0:1782727919.218740:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727919.218773:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff79c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572018688:0@lo:400:kworker.0 00000100:00100000:2.0:1782727919.218802:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727919.218841:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572018432 00000100:00100000:2.0:1782727919.218848:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572018432 00000100:00100000:2.0:1782727919.218907:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572018560 00000100:00100000:2.0:1782727919.218911:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572018560 00000100:00100000:2.0:1782727919.218938:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572018304 00000100:00100000:2.0:1782727919.218941:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572018304 00000100:00100000:2.0:1782727919.218959:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782727919.218969:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff79e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869325572018432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727919.219037:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff79e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869325572018432:12345-0@lo:400:kworker.0 Request processed in 68us (2064us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727919.219045:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782727919.219063:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782727919.219070:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff79d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869325572018560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727919.219098:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff79d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869325572018560:12345-0@lo:400:kworker.0 Request processed in 29us (2066us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727919.219104:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782727919.219114:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782727919.220263:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c7439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869325572018304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727919.220422:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c7439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869325572018304:12345-0@lo:400:kworker.0 Request processed in 177us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727919.220431:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782727919.220481:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572018176 00000100:00100000:2.0:1782727919.220489:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572018176 00000100:00100000:2.0:1782727919.220540:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1782727919.220548:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3317:x1869325572018176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727919.220582:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3317:x1869325572018176:12345-0@lo:400:kworker.0 Request processed in 35us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727919.220587:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1782727919.220623:0:8323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572018688 00000100:00100000:2.0:1782727919.220628:0:8323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572018688 00000100:00100000:2.0:1782727919.220662:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782727919.220669:0:8323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c743b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572018688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727919.220705:0:8323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c743b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572018688:12345-0@lo:400:kworker.0 Request processed in 36us (1902us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727919.220712:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1782727919.220730:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782727919.220735:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727919.220785:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869325572018560:0@lo:400:kworker.0 00000100:00100000:2.0:1782727919.220801:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869325572018432:0@lo:400:kworker.0 00000100:00100000:2.0:1782727919.220846:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3317:1869325572018176:0@lo:400:kworker.0 00010000:00080000:2.0:1782727919.220859:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ff79c380 x1869325572018688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727919.220888:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff79c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572018688:0@lo:400:kworker.0 00000100:00100000:2.0:1782727919.220902:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869325572018304:0@lo:400:kworker.0 00010000:00010000:2.0:1782727919.598039:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727919.726099:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727919.726129:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572018816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727919.726221:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727919.726306:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572018816 00000100:00100000:0.0:1782727919.726316:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572018816 00000100:00100000:0.0:1782727919.726372:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782727919.726383:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff74b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572018816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727919.726434:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782727919.726487:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff74b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572018816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727919.726495:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1782727919.726576:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ff748a80 x1869325572018816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727919.726599:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572018816:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1782727920.097663:0:8662:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg231-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1782727920.627237:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727920.867491:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727920.867574:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727920.867612:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727920.867694:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727920.867731:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552066304 00000100:00100000:1.0:1782727920.867743:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552066304 00000100:00100000:1.0:1782727920.867830:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552066432 00000100:00100000:1.0:1782727920.867834:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552066432 00000100:00100000:1.0:1782727920.867883:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 10 00000100:00100000:1.0:1782727920.867896:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f95af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2351:x1869325552066304:12345-192.168.202.31@tcp:9:kworker.0 00000020:00000080:1.0:1782727920.867954:0:6604:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22171c6c29614d99 00000100:00080000:1.0:1782727920.867967:0:6604:0:(import.c:65:import_set_state_nolock()) ffff8d56c7560800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782727920.868013:0:6604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1782727920.868471:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f95af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+2:2351:x1869325552066304:12345-192.168.202.31@tcp:9:kworker.0 Request processed in 575us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727920.868481:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 10 00000100:00100000:1.0:1782727920.868501:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 11 00000100:00100000:1.0:1782727920.868535:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f95ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2351:x1869325552066432:12345-192.168.202.31@tcp:9:kworker.0 00000020:00000080:1.0:1782727920.868553:0:6604:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x22171c6c29614da0 00000100:00080000:1.0:1782727920.868561:0:6604:0:(import.c:65:import_set_state_nolock()) ffff8d56c7562800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782727920.868592:0:6604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1782727920.868794:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f95ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+2:2351:x1869325552066432:12345-192.168.202.31@tcp:9:kworker.0 Request processed in 285us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727920.868802:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 11 00000100:00080000:1.0:1782727920.868829:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782727920.868834:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782727920.868905:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727920.868924:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727920.870343:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552066048 00000100:00100000:3.0:1782727920.870359:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552066048 00000100:00100000:3.0:1782727920.870440:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 196 00000100:00100000:3.0:1782727920.870450:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2352:x1869325552066048:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782727920.870565:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2352:x1869325552066048:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 115us (3088us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727920.870589:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 196 00000100:00100000:3.0:1782727920.873334:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552066176 00000100:00100000:3.0:1782727920.873354:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552066176 00000100:00100000:3.0:1782727920.873444:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 39 00000100:00100000:3.0:1782727920.873455:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f95af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2352:x1869325552066176:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782727920.873905:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f95af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2352:x1869325552066176:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 449us (6327us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727920.874028:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 39 00000100:00080000:1.0:1782727920.875443:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782727921.649012:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727922.669787:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782727923.376651:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f9926b93-a1e5-4dad-ade1-7cd7c966fac6 00000020:00000080:2.0:1782727923.376663:0:7498:0:(genops.c:906:class_export_put()) final put ffff8d56c7565000/f9926b93-a1e5-4dad-ade1-7cd7c966fac6 00000020:00000080:2.0:1782727923.376700:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8d56c7565000/f9926b93-a1e5-4dad-ade1-7cd7c966fac6 for lustre-OST0001 00000020:00000080:2.0:1782727923.376754:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d56c7562800 for lustre-OST0001 00010000:00010000:3.0:1782727923.697710:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782727923.942811:0:6630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f9926b93-a1e5-4dad-ade1-7cd7c966fac6 00000020:00000080:2.0:1782727923.942824:0:6630:0:(genops.c:906:class_export_put()) final put ffff8d56c7563800/f9926b93-a1e5-4dad-ade1-7cd7c966fac6 00000020:00000080:3.0:1782727923.943066:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8d56c7563800/f9926b93-a1e5-4dad-ade1-7cd7c966fac6 for lustre-OST0000 00000020:00000080:3.0:1782727923.943134:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8d56c7560800 for lustre-OST0000 00000100:00100000:3.0:1782727924.337687:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff79ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572018944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727924.337788:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727924.338085:0:8059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572018944 00000100:00100000:3.0:1782727924.338096:0:8059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572018944 00000100:00100000:3.0:1782727924.338175:0:8059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782727924.338187:0:8059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572018944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727924.338240:0:8059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782727924.338300:0:8059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff79ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572018944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727924.338308:0:8059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1782727924.338334:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782727924.338373:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ff79ea00 x1869325572018944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727924.338399:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff79ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572018944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727924.339754:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727924.339927:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f95ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869325572019200:0@lo:400:kworker.0 00000100:00100000:2.0:1782727924.340008:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727924.340060:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572019200 00000100:00100000:2.0:1782727924.340067:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572019200 00000100:00100000:2.0:1782727924.340111:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782727924.340120:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c743b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869325572019200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727924.340173:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c743b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869325572019200:12345-0@lo:400:kworker.0 Request processed in 54us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727924.340181:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782727924.340226:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f95ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869325572019200:0@lo:400:kworker.0 00000100:00100000:2.0:1782727924.340955:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782727924.340967:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f95aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869325572019328:0@lo:400:kworker.0 00000100:00100000:2.0:1782727924.341008:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727924.341197:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572019328 00000100:00100000:3.0:1782727924.341203:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572019328 00000100:00100000:3.0:1782727924.341242:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782727924.341250:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c7438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869325572019328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727924.341298:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c7438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869325572019328:12345-0@lo:400:kworker.0 Request processed in 49us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727924.341304:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1782727924.341325:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727924.341351:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f95aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869325572019328:0@lo:400:kworker.0 00000100:00100000:0.0:1782727924.345137:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f95af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869325572019456:0@lo:400:kworker.0 00000100:00100000:0.0:1782727924.345258:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727924.345314:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f95aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572019072:0@lo:400:kworker.0 00000100:00100000:0.0:1782727924.345349:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727924.345424:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572019072 00000100:00100000:0.0:1782727924.345433:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572019072 00000100:00100000:0.0:1782727924.345503:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1782727924.345542:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3314:x1869325572019072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727924.345605:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3314:x1869325572019072:12345-0@lo:400:kworker.0 Request processed in 67us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727924.345614:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1782727924.345676:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f95aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572019072:0@lo:400:kworker.0 00000100:00100000:3.0:1782727924.346179:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572019456 00000100:00100000:3.0:1782727924.346184:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572019456 00000100:00100000:3.0:1782727924.346231:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782727924.346239:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869325572019456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727924.346289:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869325572019456:12345-0@lo:400:kworker.0 Request processed in 51us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727924.346295:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1782727924.351591:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727924.351671:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f95af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869325572019456:0@lo:400:kworker.0 00000100:00100000:1.0:1782727924.354276:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f95ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572019584:0@lo:400:kworker.0 00000100:00100000:1.0:1782727924.354379:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727924.354444:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572019584 00000100:00100000:1.0:1782727924.354929:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572019584 00000100:00100000:1.0:1782727924.355262:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782727924.355274:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f95ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572019584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727924.355362:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f95ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572019584:12345-0@lo:400:kworker.0 Request processed in 90us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727924.355371:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1782727924.355426:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f95ac380 x1869325572019584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727924.355443:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f95ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572019584:0@lo:400:kworker.0 00000100:00080000:0.0:1782727924.356897:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782727924.723166:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727924.854420:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572019712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727924.854852:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727924.855856:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572019712 00000100:00100000:0.0:1782727924.855872:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572019712 00000100:00100000:0.0:1782727924.855964:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782727924.855979:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572019712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727924.856061:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782727924.856159:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff79ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572019712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 184us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727924.856177:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1782727924.858132:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ff748380 x1869325572019712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727924.858164:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572019712:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782727925.741633:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727925.983609:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727925.983664:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727925.983791:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552066688 00000100:00100000:2.0:1782727925.983804:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552066688 00000100:00100000:2.0:1782727925.983890:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 43 00000100:00100000:2.0:1782727925.983901:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f95ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2355:x1869325552066688:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782727925.983999:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f95ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2355:x1869325552066688:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 99us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727925.984007:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 43 00000100:00080000:1.0:1782727925.984071:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727925.984176:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552066560 00000100:00100000:3.0:1782727925.984181:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552066560 00000100:00100000:3.0:1782727925.984223:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 198 00000100:00100000:3.0:1782727925.984231:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+10:2355:x1869325552066560:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782727925.984272:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+10:2355:x1869325552066560:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 42us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727925.984280:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 198 00000001:02000400:3.0:1782727926.165426:0:8910:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg231-server.virtnet: executing yml_node 00010000:00010000:1.0:1782727926.767328:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727927.789919:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727928.813868:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727929.458790:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572020224:0@lo:400:kworker.0 00000100:00100000:0.0:1782727929.458874:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727929.458928:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782727929.458944:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff74ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572019840:0@lo:400:kworker.0 00000100:00100000:0.0:1782727929.458977:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727929.458998:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869325572020352:0@lo:400:kworker.0 00000100:00100000:0.0:1782727929.459020:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727929.459042:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff74a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869325572019968:0@lo:400:kworker.0 00000100:00100000:0.0:1782727929.459061:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727929.459247:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572020480:0@lo:400:kworker.0 00000100:00100000:0.0:1782727929.459272:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727929.459299:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727929.459305:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869325572020096:0@lo:400:kworker.0 00000100:00100000:0.0:1782727929.459326:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727929.459436:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572020224 00000100:00100000:2.0:1782727929.459444:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572020224 00000100:00100000:2.0:1782727929.459494:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572020480 00000100:00100000:2.0:1782727929.459497:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572020480 00000100:00100000:2.0:1782727929.459540:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782727929.459550:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572020224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727929.459603:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572020224:12345-0@lo:400:kworker.0 Request processed in 55us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727929.459610:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782727929.459627:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782727929.459633:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572020480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727929.459663:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572020480:12345-0@lo:400:kworker.0 Request processed in 30us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727929.459670:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782727929.459687:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572020352 00000100:00100000:2.0:1782727929.459690:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572020352 00000100:00100000:2.0:1782727929.459712:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572019968 00000100:00100000:2.0:1782727929.459715:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572019968 00000100:00100000:2.0:1782727929.459725:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572020096 00000100:00100000:2.0:1782727929.459727:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572020096 00000100:00100000:2.0:1782727929.459741:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782727929.459756:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869325572020352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727929.459788:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869325572020352:12345-0@lo:400:kworker.0 Request processed in 33us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727929.459794:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782727929.459806:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782727929.459812:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869325572019968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727929.459835:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869325572019968:12345-0@lo:400:kworker.0 Request processed in 24us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727929.459854:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782727929.459865:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782727929.459871:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869325572020096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727929.459895:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869325572020096:12345-0@lo:400:kworker.0 Request processed in 25us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727929.459901:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1782727929.459915:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782727929.459920:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782727929.459922:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727929.459958:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869325572020096:0@lo:400:kworker.0 00000100:00100000:2.0:1782727929.459968:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff74a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869325572019968:0@lo:400:kworker.0 00010000:00080000:2.0:1782727929.459979:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56d09ab800 x1869325572020480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727929.459990:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572020480:0@lo:400:kworker.0 00000100:00100000:2.0:1782727929.460022:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869325572020352:0@lo:400:kworker.0 00010000:00080000:2.0:1782727929.460032:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56d09a8a80 x1869325572020224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727929.460047:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572020224:0@lo:400:kworker.0 00000100:00100000:0.0:1782727929.460262:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572019840 00000100:00100000:0.0:1782727929.460267:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572019840 00000100:00100000:0.0:1782727929.460306:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1782727929.460314:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3316:x1869325572019840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727929.460434:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3316:x1869325572019840:12345-0@lo:400:kworker.0 Request processed in 121us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727929.460442:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1782727929.460484:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff74ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572019840:0@lo:400:kworker.0 00000100:00100000:1.0:1782727929.461721:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572020608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727929.461776:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727929.462329:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572020608 00000100:00100000:0.0:1782727929.462337:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572020608 00000100:00100000:0.0:1782727929.462622:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782727929.462631:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f95ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572020608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727929.462667:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782727929.462721:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f95ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572020608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727929.462742:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1782727929.462784:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f5ae2a00 x1869325572020608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727929.462804:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572020608:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782727929.839417:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782727929.942678:0:9103:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.83 00000100:00100000:1.0:1782727929.970720:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782727929.970743:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f95af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572020736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727929.970925:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727929.970993:0:8059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572020736 00000100:00100000:1.0:1782727929.971000:0:8059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572020736 00000100:00100000:1.0:1782727929.971047:0:8059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782727929.971055:0:8059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f95aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572020736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727929.971090:0:8059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782727929.971133:0:8059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f95aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572020736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727929.971140:0:8059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1782727929.971188:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f95af480 x1869325572020736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727929.971206:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f95af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572020736:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782727930.862022:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727931.102209:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727931.102262:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727931.102303:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552066816 00000100:00100000:3.0:1782727931.102316:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552066816 00000100:00100000:3.0:1782727931.102381:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 200 00000100:00100000:3.0:1782727931.102395:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+10:2355:x1869325552066816:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782727931.102488:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+10:2355:x1869325552066816:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 96us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727931.102498:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 200 00000100:00100000:3.0:1782727931.103807:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552066944 00000100:00100000:3.0:1782727931.103821:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552066944 00000100:00100000:3.0:1782727931.104213:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 47 00000100:00100000:3.0:1782727931.104224:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff79fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2355:x1869325552066944:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782727931.104302:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff79fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2355:x1869325552066944:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 80us (2039us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727931.104311:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 47 00000100:00080000:2.0:1782727931.111979:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782727931.885793:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782727932.465750:0:9200:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.83 00010000:00010000:0.0:1782727932.914190:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727933.933757:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727934.573875:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727934.573905:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572020864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727934.574011:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727934.574085:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572020864 00000100:00100000:0.0:1782727934.574095:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572020864 00000100:00100000:0.0:1782727934.574174:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782727934.574185:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572020864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727934.574232:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782727934.574284:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572020864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727934.574292:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1782727934.574340:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f5ae2a00 x1869325572020864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727934.574364:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572020864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727934.575158:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c7438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869325572021376:0@lo:400:kworker.0 00000100:00080000:2.0:1782727934.575183:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727934.575217:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727934.575260:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782727934.575277:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c7439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869325572021248:0@lo:400:kworker.0 00000100:00100000:2.0:1782727934.575278:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c7438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572020992:0@lo:400:kworker.0 00000100:00100000:3.0:1782727934.575310:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727934.575337:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727934.575354:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572021376 00000100:00100000:3.0:1782727934.575360:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572021376 00000100:00100000:2.0:1782727934.575372:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c743b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572021504:0@lo:400:kworker.0 00000100:00100000:2.0:1782727934.575407:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727934.575411:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572021248 00000100:00100000:3.0:1782727934.575415:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572021248 00000100:00100000:2.0:1782727934.575435:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727934.575443:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c743ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869325572021120:0@lo:400:kworker.0 00000100:00100000:3.0:1782727934.575447:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782727934.575458:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff79d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869325572021376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727934.575470:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727934.575496:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572020992 00000100:00100000:2.0:1782727934.575500:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572020992 00000100:00100000:3.0:1782727934.575529:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff79d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869325572021376:12345-0@lo:400:kworker.0 Request processed in 73us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727934.575538:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782727934.575557:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572021120 00000100:00100000:2.0:1782727934.575558:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1782727934.575562:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572021120 00000100:00100000:2.0:1782727934.575570:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3314:x1869325572020992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727934.575583:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782727934.575590:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff79e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869325572021248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727934.575613:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3314:x1869325572020992:12345-0@lo:400:kworker.0 Request processed in 45us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727934.575621:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1782727934.575627:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff79e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869325572021248:12345-0@lo:400:kworker.0 Request processed in 37us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727934.575634:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782727934.575647:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782727934.575654:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c743aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869325572021120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727934.575660:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572021504 00000100:00100000:2.0:1782727934.575664:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572021504 00000100:00100000:3.0:1782727934.575685:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c743aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869325572021120:12345-0@lo:400:kworker.0 Request processed in 31us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727934.575691:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782727934.575699:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782727934.575708:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c7439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572021504:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782727934.575727:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782727934.575733:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727934.575747:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c7439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572021504:12345-0@lo:400:kworker.0 Request processed in 39us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727934.575763:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782727934.575771:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c7439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869325572021248:0@lo:400:kworker.0 00000100:00100000:3.0:1782727934.575784:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c7438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869325572021376:0@lo:400:kworker.0 00000100:00100000:2.0:1782727934.575813:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c743ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869325572021120:0@lo:400:kworker.0 00000100:00100000:2.0:1782727934.575825:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c7438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572020992:0@lo:400:kworker.0 00010000:00080000:2.0:1782727934.575837:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56c743b480 x1869325572021504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727934.575847:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c743b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572021504:0@lo:400:kworker.0 00010000:00010000:1.0:1782727934.961402:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727935.089357:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff79dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572021632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727935.089456:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727935.089491:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572021632 00000100:00100000:1.0:1782727935.089501:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572021632 00000100:00100000:1.0:1782727935.089576:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782727935.089586:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff79c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572021632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727935.089636:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782727935.089711:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff79c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572021632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727935.090053:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1782727935.090130:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ff79dc00 x1869325572021632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727935.090151:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff79dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572021632:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1782727935.106767:0:9299:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.83 00010000:00010000:0.0:1782727935.984858:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727936.230325:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727936.230377:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727936.230383:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552067072 00000100:00100000:3.0:1782727936.230396:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552067072 00000100:00100000:3.0:1782727936.230653:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 202 00000100:00100000:0.0:1782727936.230671:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552067200 00000100:00100000:3.0:1782727936.230676:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2355:x1869325552067072:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782727936.230676:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552067200 00000100:00100000:0.0:1782727936.230731:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 51 00000100:00100000:0.0:1782727936.230739:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f95af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2355:x1869325552067200:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782727936.230795:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2355:x1869325552067072:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 118us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727936.230804:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 202 00000100:00080000:1.0:1782727936.230814:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727936.238204:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f95af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2355:x1869325552067200:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 7443us (7804us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727936.238252:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 51 00000001:02000400:1.0:1782727936.914341:0:9347:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity ============----- Mon Jun 29 06:12:15 EDT 2026 00010000:00010000:1.0:1782727937.005899:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727938.033261:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727939.053823:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727939.693883:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572021760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727939.694019:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727939.694628:0:8059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572021760 00000100:00100000:1.0:1782727939.694639:0:8059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572021760 00000100:00100000:1.0:1782727939.694714:0:8059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782727939.694726:0:8059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c743b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572021760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782727939.694783:0:8059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782727939.695379:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff79dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3317:1869325572021888:0@lo:400:kworker.0 00000100:00100000:3.0:1782727939.695432:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727939.695470:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff79c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572022400:0@lo:400:kworker.0 00000100:00100000:3.0:1782727939.695496:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727939.695534:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782727939.695540:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869325572022272:0@lo:400:kworker.0 00000100:00100000:3.0:1782727939.695566:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727939.695593:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff79f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869325572022144:0@lo:400:kworker.0 00000100:00100000:3.0:1782727939.695618:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727939.695636:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782727939.695641:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff79df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869325572022016:0@lo:400:kworker.0 00000100:00100000:3.0:1782727939.695695:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727939.695728:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572021888 00000100:00100000:3.0:1782727939.695733:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572021888 00000100:00100000:3.0:1782727939.695784:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1782727939.695792:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3317:x1869325572021888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727939.695837:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3317:x1869325572021888:12345-0@lo:400:kworker.0 Request processed in 46us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727939.695845:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1782727939.695883:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572022400 00000100:00100000:3.0:1782727939.695887:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572022400 00000100:00100000:3.0:1782727939.695919:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782727939.695925:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572022400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727939.695957:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff79ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572022400:12345-0@lo:400:kworker.0 Request processed in 32us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727939.695962:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782727939.695981:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572022272 00000100:00100000:3.0:1782727939.695984:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572022272 00000100:00100000:3.0:1782727939.696009:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572022144 00000100:00100000:3.0:1782727939.696011:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572022144 00000100:00100000:3.0:1782727939.696021:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572022016 00000100:00100000:3.0:1782727939.696023:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572022016 00000100:00100000:3.0:1782727939.696035:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782727939.696040:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff79d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869325572022272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727939.696081:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff79d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869325572022272:12345-0@lo:400:kworker.0 Request processed in 41us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727939.696088:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782727939.696100:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782727939.696106:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff79ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869325572022144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727939.696147:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff79ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869325572022144:12345-0@lo:400:kworker.0 Request processed in 41us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727939.696154:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782727939.696164:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782727939.696170:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff79c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869325572022016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727939.696194:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff79c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869325572022016:12345-0@lo:400:kworker.0 Request processed in 24us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727939.696199:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782727939.696260:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff79df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869325572022016:0@lo:400:kworker.0 00000100:00100000:3.0:1782727939.696271:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff79f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869325572022144:0@lo:400:kworker.0 00000100:00100000:3.0:1782727939.696299:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869325572022272:0@lo:400:kworker.0 00000100:00100000:3.0:1782727939.696306:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff79dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3317:1869325572021888:0@lo:400:kworker.0 00010000:00080000:3.0:1782727939.696318:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ff79c700 x1869325572022400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727939.696329:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff79c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572022400:0@lo:400:kworker.0 00000100:00100000:1.0:1782727939.696841:0:8059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c743b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572021760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2115us (2819us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727939.696852:0:8059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1782727939.696892:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782727939.696899:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782727939.696902:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782727939.697576:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f5ae2a00 x1869325572021760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727939.697607:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572021760:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782727940.077708:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727940.211677:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f95aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572022528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727940.211800:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727940.212045:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572022528 00000100:00100000:1.0:1782727940.212056:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572022528 00000100:00100000:1.0:1782727940.212127:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782727940.212139:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff79c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572022528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727940.212187:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782727940.212245:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff79c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572022528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727940.212252:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1782727940.212384:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f95aca80 x1869325572022528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727940.212406:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f95aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572022528:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782727941.107446:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727941.343702:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727941.344288:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727941.346077:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552067328 00000100:00100000:2.0:1782727941.346098:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552067328 00000100:00100000:2.0:1782727941.346179:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 204 00000100:00100000:2.0:1782727941.346193:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2352:x1869325552067328:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782727941.346306:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2352:x1869325552067328:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 115us (2018us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727941.346314:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 204 00000100:00100000:0.0:1782727941.353341:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552067456 00000100:00100000:0.0:1782727941.353363:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552067456 00000100:00100000:0.0:1782727941.357396:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 55 00000100:00100000:0.0:1782727941.357422:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff79dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2353:x1869325552067456:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782727941.357568:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff79dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2353:x1869325552067456:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 156us (13883us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727941.357577:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 55 00000100:00080000:1.0:1782727941.364913:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782727942.126554:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727943.149888:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727944.177953:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727944.813895:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572023040:0@lo:400:kworker.0 00000100:00100000:3.0:1782727944.814009:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727944.814082:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782727944.814089:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572022656:0@lo:400:kworker.0 00000100:00100000:3.0:1782727944.814128:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727944.814151:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869325572023168:0@lo:400:kworker.0 00000100:00100000:3.0:1782727944.814180:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727944.814209:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff79f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869325572022784:0@lo:400:kworker.0 00000100:00100000:3.0:1782727944.814232:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727944.814249:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572023296:0@lo:400:kworker.0 00000100:00100000:3.0:1782727944.814270:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727944.814290:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727944.814295:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff79df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869325572022912:0@lo:400:kworker.0 00000100:00100000:3.0:1782727944.814317:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727944.814353:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572023040 00000100:00100000:3.0:1782727944.814362:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572023040 00000100:00100000:3.0:1782727944.814424:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572023296 00000100:00100000:3.0:1782727944.814427:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572023296 00000100:00100000:3.0:1782727944.814451:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782727944.814461:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5cce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572023040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727944.814558:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5cce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572023040:12345-0@lo:400:kworker.0 Request processed in 98us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727944.814566:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782727944.814585:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782727944.814592:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572023296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727944.814637:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572023296:12345-0@lo:400:kworker.0 Request processed in 46us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727944.814644:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782727944.814664:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572022656 00000100:00100000:3.0:1782727944.814668:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572022656 00000100:00100000:3.0:1782727944.814694:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1782727944.814701:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3314:x1869325572022656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727944.814745:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3314:x1869325572022656:12345-0@lo:400:kworker.0 Request processed in 44us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727944.814751:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1782727944.814782:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572023168 00000100:00100000:3.0:1782727944.814786:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572023168 00000100:00100000:3.0:1782727944.814813:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572022784 00000100:00100000:3.0:1782727944.814816:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572022784 00000100:00100000:3.0:1782727944.814826:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572022912 00000100:00100000:3.0:1782727944.814829:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572022912 00000100:00100000:3.0:1782727944.814844:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782727944.814850:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869325572023168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727944.814880:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869325572023168:12345-0@lo:400:kworker.0 Request processed in 30us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727944.814886:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782727944.814899:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782727944.814905:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869325572022784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727944.814934:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869325572022784:12345-0@lo:400:kworker.0 Request processed in 30us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727944.814940:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1782727944.814951:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782727944.814964:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869325572022912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727944.814991:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869325572022912:12345-0@lo:400:kworker.0 Request processed in 29us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727944.814997:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782727944.815069:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff79df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869325572022912:0@lo:400:kworker.0 00000100:00100000:3.0:1782727944.815082:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff79f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869325572022784:0@lo:400:kworker.0 00010000:00080000:3.0:1782727944.815096:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f5ccd180 x1869325572023296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727944.815107:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572023296:0@lo:400:kworker.0 00000100:00100000:3.0:1782727944.815142:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff79f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572022656:0@lo:400:kworker.0 00000100:00100000:3.0:1782727944.815152:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869325572023168:0@lo:400:kworker.0 00010000:00080000:3.0:1782727944.815162:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ff79f480 x1869325572023040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727944.815171:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572023040:0@lo:400:kworker.0 00000100:00080000:1.0:1782727944.815419:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782727944.815425:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782727944.815428:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782727944.816637:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727944.816658:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572023424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727944.816741:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727944.816806:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572023424 00000100:00100000:1.0:1782727944.816812:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572023424 00000100:00100000:1.0:1782727944.816862:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782727944.816869:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f95ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572023424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782727944.816911:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782727944.816957:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f95ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572023424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727944.816965:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1782727944.817024:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f5ccfb80 x1869325572023424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727944.817060:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572023424:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782727945.197725:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727945.330621:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f95ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572023552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727945.330736:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727945.330952:0:8059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572023552 00000100:00100000:3.0:1782727945.330962:0:8059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572023552 00000100:00100000:3.0:1782727945.331037:0:8059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782727945.331048:0:8059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f95afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572023552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727945.331095:0:8059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782727945.331165:0:8059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f95afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572023552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727945.331174:0:8059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1782727945.331217:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f95ad180 x1869325572023552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727945.331242:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f95ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572023552:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782727946.225991:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727946.465073:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727946.465127:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727946.465223:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552067584 00000100:00100000:2.0:1782727946.465235:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552067584 00000100:00100000:2.0:1782727946.465309:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 206 00000100:00100000:2.0:1782727946.465320:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+10:2353:x1869325552067584:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782727946.465404:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+10:2353:x1869325552067584:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 86us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727946.465413:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 206 00000100:00100000:3.0:1782727946.467081:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552067712 00000100:00100000:3.0:1782727946.467107:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552067712 00000100:00100000:3.0:1782727946.467186:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 59 00000100:00100000:3.0:1782727946.467196:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f95ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2353:x1869325552067712:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782727946.467287:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f95ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2353:x1869325552067712:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 92us (2224us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727946.467295:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 59 00000100:00080000:1.0:1782727946.467396:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782727947.247769:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727948.270692:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727949.299173:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727949.933805:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572023680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727949.933905:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727949.934169:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572023680 00000100:00100000:3.0:1782727949.934181:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572023680 00000100:00100000:3.0:1782727949.934307:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782727949.934319:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f95ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572023680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727949.934380:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782727949.934446:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f95ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572023680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727949.934454:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1782727949.934640:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f5ccd180 x1869325572023680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727949.934674:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572023680:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782727949.935203:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782727949.935536:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c743bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869325572024192:0@lo:400:kworker.0 00000100:00100000:2.0:1782727949.935598:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727949.935630:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782727949.935638:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c7438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869325572024064:0@lo:400:kworker.0 00000100:00100000:1.0:1782727949.935672:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c7438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572023808:0@lo:400:kworker.0 00000100:00100000:2.0:1782727949.935676:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727949.935724:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727949.935772:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c7439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572024320:0@lo:400:kworker.0 00000100:00100000:1.0:1782727949.935802:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727949.935888:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727949.935895:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c743ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869325572023936:0@lo:400:kworker.0 00000100:00100000:1.0:1782727949.935922:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727949.935973:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572023808 00000100:00100000:0.0:1782727949.935975:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572024320 00000100:00100000:2.0:1782727949.935980:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572023808 00000100:00100000:0.0:1782727949.935982:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572024320 00000100:00100000:2.0:1782727949.936021:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1782727949.936027:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3316:x1869325572023808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727949.936082:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782727949.936084:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572024192 00000100:00100000:3.0:1782727949.936088:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572024192 00000100:00100000:0.0:1782727949.936093:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f95aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572024320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727949.936148:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3316:x1869325572023808:12345-0@lo:400:kworker.0 Request processed in 118us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727949.936156:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1782727949.936160:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f95aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572024320:12345-0@lo:400:kworker.0 Request processed in 65us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727949.936169:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782727949.936200:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c7438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572023808:0@lo:400:kworker.0 00010000:00080000:2.0:1782727949.936211:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56c7439180 x1869325572024320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727949.936219:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c7439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572024320:0@lo:400:kworker.0 00000100:00100000:0.0:1782727949.936246:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572024064 00000100:00100000:0.0:1782727949.936252:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572024064 00000100:00100000:2.0:1782727949.936258:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572023936 00000100:00100000:2.0:1782727949.936262:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572023936 00000100:00100000:2.0:1782727949.936294:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782727949.936299:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f95ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869325572023936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727949.936323:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f95ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869325572023936:12345-0@lo:400:kworker.0 Request processed in 25us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727949.936333:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782727949.936354:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c743ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869325572023936:0@lo:400:kworker.0 00000100:00080000:1.0:1782727949.936644:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782727949.936650:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727949.939931:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782727949.939951:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c7438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869325572024064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727949.940079:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c7438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869325572024064:12345-0@lo:400:kworker.0 Request processed in 134us (4413us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727949.940088:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1782727949.940174:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c7438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869325572024064:0@lo:400:kworker.0 00000100:00100000:3.0:1782727949.942011:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782727949.942031:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c7439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869325572024192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727949.942165:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c7439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869325572024192:12345-0@lo:400:kworker.0 Request processed in 143us (6567us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727949.942173:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782727949.942276:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c743bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869325572024192:0@lo:400:kworker.0 00010000:00010000:1.0:1782727950.321404:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727950.447188:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782727950.447218:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f95aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572024448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727950.447339:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727950.447433:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572024448 00000100:00100000:1.0:1782727950.447449:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572024448 00000100:00100000:1.0:1782727950.447538:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782727950.447549:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f44a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572024448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727950.447597:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782727950.450313:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f44a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572024448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2752us (2961us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727950.450332:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1782727950.450418:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f95aca80 x1869325572024448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727950.450445:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f95aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572024448:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782727951.341828:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727951.582393:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782727951.582480:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552067840 00000100:00100000:0.0:1782727951.582490:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552067840 00000100:00100000:0.0:1782727951.582573:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 208 00000100:00100000:0.0:1782727951.582584:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+10:2355:x1869325552067840:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782727951.582669:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+10:2355:x1869325552067840:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 87us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727951.582677:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 208 00000100:00100000:3.0:1782727951.583843:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727951.583906:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552067968 00000100:00100000:2.0:1782727951.583912:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552067968 00000100:00100000:2.0:1782727951.583989:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 63 00000100:00100000:2.0:1782727951.583998:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2355:x1869325552067968:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782727951.584057:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2355:x1869325552067968:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 60us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727951.584065:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 63 00000100:00080000:3.0:1782727951.584270:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782727952.365930:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727953.389955:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782727953.797425:0:10075:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION <= 2.16.61-1-g89cf292a8c2 (34682451 <= 34618625) for LU-18938, skip 360 00010000:00010000:0.0:1782727954.420390:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782727954.974000:0:10123:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need MDS1_VERSION < v2_14_55-100-g8a84c7f9c7 (34682451 < 34486116) for LU-14927, skip 0f 00000100:00100000:2.0:1782727955.053864:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782727955.053896:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572024576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727955.053994:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727955.054226:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572024576 00000100:00100000:3.0:1782727955.054235:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572024576 00000100:00100000:3.0:1782727955.054317:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782727955.054327:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c7438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572024576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727955.054371:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782727955.054420:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c7438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572024576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727955.054428:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782727955.054452:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869325572024832:0@lo:400:kworker.0 00000100:00100000:3.0:1782727955.054480:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727955.054501:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727955.054506:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869325572024960:0@lo:400:kworker.0 00000100:00100000:3.0:1782727955.054612:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782727955.054650:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727955.054666:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572024832 00000100:00100000:3.0:1782727955.054670:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572024832 00000100:00100000:3.0:1782727955.054697:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572024960 00000100:00100000:3.0:1782727955.054700:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572024960 00000100:00100000:3.0:1782727955.054721:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782727955.054727:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869325572024832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727955.054764:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5cce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869325572024832:12345-0@lo:400:kworker.0 Request processed in 37us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727955.054771:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782727955.054784:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782727955.054790:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869325572024960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727955.054814:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869325572024960:12345-0@lo:400:kworker.0 Request processed in 25us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727955.054821:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1782727955.054842:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727955.054879:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869325572024960:0@lo:400:kworker.0 00000100:00100000:3.0:1782727955.054889:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869325572024832:0@lo:400:kworker.0 00000100:00100000:2.0:1782727955.054965:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3315:1869325572024704:0@lo:400:kworker.0 00000100:00100000:2.0:1782727955.054999:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727955.055035:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572025216:0@lo:400:kworker.0 00000100:00100000:2.0:1782727955.055063:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727955.055169:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869325572025088:0@lo:400:kworker.0 00000100:00100000:0.0:1782727955.055201:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727955.055235:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572025088 00000100:00100000:0.0:1782727955.055239:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572025088 00000100:00100000:0.0:1782727955.055269:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782727955.055275:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869325572025088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727955.055307:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869325572025088:12345-0@lo:400:kworker.0 Request processed in 32us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727955.055323:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1782727955.055338:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727955.055353:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869325572025088:0@lo:400:kworker.0 00000100:00100000:3.0:1782727955.055408:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572024704 00000100:00100000:3.0:1782727955.055411:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572024704 00000100:00100000:3.0:1782727955.055443:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1782727955.055449:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3315:x1869325572024704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727955.055476:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3315:x1869325572024704:12345-0@lo:400:kworker.0 Request processed in 27us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727955.055482:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00010000:00080000:2.0:1782727955.055660:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f5ccc700 x1869325572024576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727955.055679:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ccc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572024576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727955.055695:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3315:1869325572024704:0@lo:400:kworker.0 00000100:00100000:3.0:1782727955.056145:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572025216 00000100:00100000:3.0:1782727955.056150:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572025216 00000100:00100000:3.0:1782727955.056191:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782727955.056197:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c743ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572025216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727955.056242:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c743ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572025216:12345-0@lo:400:kworker.0 Request processed in 45us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727955.056249:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1782727955.056274:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f5ccc380 x1869325572025216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727955.056285:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572025216:0@lo:400:kworker.0 00000100:00080000:0.0:1782727955.056329:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782727955.438272:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727955.569568:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c7439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572025344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727955.569700:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727955.569827:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572025344 00000100:00100000:1.0:1782727955.569839:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572025344 00000100:00100000:1.0:1782727955.569905:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782727955.569917:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ffb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572025344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727955.569963:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782727955.571168:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ffb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572025344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1245us (1460us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727955.571183:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1782727955.571295:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56c7439180 x1869325572025344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727955.571329:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c7439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572025344:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1782727956.459041:0:10171:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: - need OST1_VERSION < v2_17_50-410-gbd8e7b9555 (34682451 < 34681754) for LU-12550, skip 216 00010000:00010000:3.0:1782727956.462751:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727956.716640:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727956.716696:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727956.716836:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552068224 00000100:00100000:3.0:1782727956.716846:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552068224 00000100:00100000:3.0:1782727956.716930:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 67 00000100:00100000:3.0:1782727956.716941:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f44a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2353:x1869325552068224:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782727956.717021:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f44a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2353:x1869325552068224:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 82us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727956.717037:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 67 00000100:00080000:1.0:1782727956.717345:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727956.717421:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552068096 00000100:00100000:0.0:1782727956.717426:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552068096 00000100:00100000:0.0:1782727956.717457:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 210 00000100:00100000:0.0:1782727956.717464:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2353:x1869325552068096:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782727956.717505:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2353:x1869325552068096:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 41us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727956.717530:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 210 00010000:00010000:2.0:1782727957.485734:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782727958.105279:0:10220:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 42a 42c 42b 118c 118d 407 119i 216 817 411a 130b 130c 130d 130e 130f 130g 00010000:00010000:0.0:1782727958.509802:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727959.535248:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782727959.600964:0:10268:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51b 51c 51e 834 00000100:00100000:1.0:1782727960.174437:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ffb12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869325572025856:0@lo:400:kworker.0 00000100:00100000:3.0:1782727960.174502:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ffb13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572025600:0@lo:400:kworker.0 00000100:00100000:1.0:1782727960.174559:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727960.174612:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572025472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727960.174628:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727960.174699:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ffb11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869325572025728:0@lo:400:kworker.0 00000100:00100000:0.0:1782727960.174708:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572025856 00000100:00100000:0.0:1782727960.174720:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572025856 00000100:00100000:2.0:1782727960.174748:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727960.174769:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727960.174803:0:8059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572025472 00000100:00100000:2.0:1782727960.174809:0:8059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572025472 00000100:00100000:2.0:1782727960.178213:0:8059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782727960.178239:0:8059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c7438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572025472:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727960.178562:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572025728 00000100:00100000:0.0:1782727960.178589:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572025728 00000100:00100000:0.0:1782727960.178658:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782727960.178670:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f44a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869325572025856:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1782727960.179386:0:8059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782727960.181170:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782727960.181197:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f44a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869325572025728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727960.185406:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ffb11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572026240:0@lo:400:kworker.0 00000100:00100000:1.0:1782727960.185471:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782727960.185610:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782727960.185617:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727960.185631:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572025600 00000100:00100000:1.0:1782727960.185639:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572025600 00000100:00100000:1.0:1782727960.185692:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1782727960.185702:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3314:x1869325572025600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727960.185757:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3314:x1869325572025600:12345-0@lo:400:kworker.0 Request processed in 56us (11130us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727960.185765:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1782727960.185819:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572026240 00000100:00100000:1.0:1782727960.185823:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572026240 00000100:00100000:1.0:1782727960.185857:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782727960.185863:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f44a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572026240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727960.186139:0:8059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c7438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572025472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7190us (10669us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727960.186153:0:8059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1782727960.186319:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f5ccc380 x1869325572025472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727960.186343:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572025472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727960.186352:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ffb11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572025984:0@lo:400:kworker.0 00000100:00100000:2.0:1782727960.186383:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727960.186450:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ffb13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572025600:0@lo:400:kworker.0 00000100:00100000:2.0:1782727960.186459:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ffb10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869325572026112:0@lo:400:kworker.0 00000100:00100000:2.0:1782727960.186487:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727960.186534:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1782727960.186543:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1782727960.186595:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572025984 00000100:00100000:2.0:1782727960.186600:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572025984 00000100:00100000:2.0:1782727960.186639:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782727960.186664:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c7439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572025984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727960.186705:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c7439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572025984:12345-0@lo:400:kworker.0 Request processed in 43us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727960.186711:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1782727960.186741:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ffb11c00 x1869325572025984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727960.186752:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ffb11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572025984:0@lo:400:kworker.0 00000100:00100000:2.0:1782727960.186889:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572026112 00000100:00100000:2.0:1782727960.186894:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572026112 00000100:00100000:2.0:1782727960.186923:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1782727960.187011:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782727960.187020:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c7439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869325572026112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727960.187085:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c7439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869325572026112:12345-0@lo:400:kworker.0 Request processed in 65us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727960.187094:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782727960.187123:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ffb10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869325572026112:0@lo:400:kworker.0 00000100:00100000:3.0:1782727960.187190:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f44a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869325572025728:12345-0@lo:400:kworker.0 Request processed in 5998us (12416us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727960.187205:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782727960.187301:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ffb11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869325572025728:0@lo:400:kworker.0 00000100:00080000:2.0:1782727960.187343:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782727960.187347:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727960.187451:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f44a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869325572025856:12345-0@lo:400:kworker.0 Request processed in 8781us (12890us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727960.187461:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782727960.187706:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ffb12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869325572025856:0@lo:400:kworker.0 00000100:00100000:1.0:1782727960.192007:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f44a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572026240:12345-0@lo:400:kworker.0 Request processed in 6133us (6526us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727960.192022:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1782727960.192215:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ffb11f80 x1869325572026240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727960.192233:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ffb11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572026240:0@lo:400:kworker.0 00010000:00010000:3.0:1782727960.558282:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727960.689373:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c743bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572026368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727960.689462:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727960.689559:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572026368 00000100:00100000:2.0:1782727960.689568:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572026368 00000100:00100000:2.0:1782727960.689626:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782727960.689647:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572026368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727960.689684:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782727960.689729:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572026368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727960.689736:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1782727960.689780:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56c743bb80 x1869325572026368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727960.689797:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c743bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572026368:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1782727961.157698:0:10317:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: start setup 06:12:40 (1782727960) === 00010000:00010000:2.0:1782727961.581738:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727961.822716:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727961.822769:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727961.822864:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552068480 00000100:00100000:2.0:1782727961.822873:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552068480 00000100:00100000:2.0:1782727961.822957:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 71 00000100:00100000:2.0:1782727961.822968:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f44a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2352:x1869325552068480:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782727961.823041:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f44a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2352:x1869325552068480:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 75us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727961.823059:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 71 00000100:00100000:3.0:1782727961.823369:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552068352 00000100:00100000:3.0:1782727961.823374:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552068352 00000100:00100000:3.0:1782727961.823410:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 212 00000100:00100000:3.0:1782727961.823418:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+10:2352:x1869325552068352:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782727961.823460:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+10:2352:x1869325552068352:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 43us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727961.823468:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 212 00000100:00080000:1.0:1782727961.823643:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782727962.606351:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727963.632117:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727964.656030:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727965.294696:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572026496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727965.294831:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727965.295077:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572026496 00000100:00100000:3.0:1782727965.295085:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572026496 00000100:00100000:3.0:1782727965.295154:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782727965.295164:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572026496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727965.295233:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782727965.295296:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572026496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727965.295303:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1782727965.295364:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782727965.295712:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f5ccd500 x1869325572026496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727965.295733:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572026496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727965.296096:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869325572026752:0@lo:400:kworker.0 00000100:00100000:1.0:1782727965.296170:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727965.296204:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782727965.296210:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3315:1869325572026624:0@lo:400:kworker.0 00000100:00100000:1.0:1782727965.296251:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727965.296274:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572027136:0@lo:400:kworker.0 00000100:00100000:1.0:1782727965.296298:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727965.296567:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869325572026880:0@lo:400:kworker.0 00000100:00100000:0.0:1782727965.296598:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727965.296629:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782727965.296635:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869325572027008:0@lo:400:kworker.0 00000100:00100000:0.0:1782727965.296656:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727965.296684:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572026752 00000100:00100000:0.0:1782727965.296690:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572026752 00000100:00100000:0.0:1782727965.296722:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572026880 00000100:00100000:0.0:1782727965.296725:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572026880 00000100:00100000:0.0:1782727965.296747:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572027008 00000100:00100000:0.0:1782727965.296750:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572027008 00000100:00100000:0.0:1782727965.296766:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782727965.296773:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f44a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869325572026752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727965.296818:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f44a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869325572026752:12345-0@lo:400:kworker.0 Request processed in 45us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727965.296837:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782727965.296856:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782727965.296863:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ffb13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869325572026880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727965.296895:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ffb13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869325572026880:12345-0@lo:400:kworker.0 Request processed in 33us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727965.296902:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782727965.296914:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782727965.296928:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ffb13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869325572027008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727965.296955:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ffb13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869325572027008:12345-0@lo:400:kworker.0 Request processed in 28us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727965.296960:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782727965.296995:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869325572027008:0@lo:400:kworker.0 00000100:00100000:0.0:1782727965.297004:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869325572026880:0@lo:400:kworker.0 00000100:00100000:2.0:1782727965.297166:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572026624 00000100:00100000:2.0:1782727965.297170:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572026624 00000100:00100000:2.0:1782727965.297205:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1782727965.297220:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3315:x1869325572026624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727965.297255:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3315:x1869325572026624:12345-0@lo:400:kworker.0 Request processed in 37us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727965.297261:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1782727965.297290:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572027136 00000100:00100000:2.0:1782727965.297294:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572027136 00000100:00100000:2.0:1782727965.297323:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782727965.297329:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f44a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572027136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727965.297361:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f44a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572027136:12345-0@lo:400:kworker.0 Request processed in 32us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727965.297367:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1782727965.297549:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782727965.297554:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727965.297573:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3315:1869325572026624:0@lo:400:kworker.0 00010000:00080000:1.0:1782727965.297586:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f5ccc380 x1869325572027136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727965.297596:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572027136:0@lo:400:kworker.0 00000100:00100000:1.0:1782727965.297605:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869325572026752:0@lo:400:kworker.0 00010000:00010000:2.0:1782727965.677672:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727965.805802:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572027264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727965.808143:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727965.808403:0:8059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572027264 00000100:00100000:2.0:1782727965.808412:0:8059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572027264 00000100:00100000:2.0:1782727965.808468:0:8059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782727965.808477:0:8059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f44a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572027264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727965.808543:0:8059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782727965.808602:0:8059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f44a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572027264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727965.808610:0:8059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1782727965.808785:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56d09ab800 x1869325572027264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727965.808806:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572027264:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782727966.702917:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727966.947778:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727966.947840:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727966.947869:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552068608 00000100:00100000:2.0:1782727966.947878:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552068608 00000100:00100000:2.0:1782727966.947920:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 214 00000100:00100000:2.0:1782727966.947928:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+10:2353:x1869325552068608:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782727966.947997:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+10:2353:x1869325552068608:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 70us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727966.948016:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 214 00000100:00100000:3.0:1782727966.948421:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552068736 00000100:00100000:3.0:1782727966.948426:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552068736 00000100:00100000:3.0:1782727966.948486:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 75 00000100:00100000:3.0:1782727966.948494:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2353:x1869325552068736:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782727966.948571:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2353:x1869325552068736:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 78us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727966.948578:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 75 00000100:00080000:2.0:1782727966.950951:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1782727967.702349:0:10510:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg231-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1782727967.728438:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727968.756865:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727969.782205:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727970.418361:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff74ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869325572027520:0@lo:400:kworker.0 00000100:00100000:2.0:1782727970.418424:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727970.418467:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572028032:0@lo:400:kworker.0 00000100:00100000:2.0:1782727970.418500:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727970.418543:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782727970.418549:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c743bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3317:1869325572027392:0@lo:400:kworker.0 00000100:00100000:2.0:1782727970.418572:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727970.418595:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869325572027904:0@lo:400:kworker.0 00000100:00100000:2.0:1782727970.418613:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727970.418633:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff74a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869325572027648:0@lo:400:kworker.0 00000100:00100000:2.0:1782727970.418650:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727970.418664:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727970.418668:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572027776:0@lo:400:kworker.0 00000100:00100000:2.0:1782727970.418697:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727970.418722:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572027520 00000100:00100000:2.0:1782727970.418729:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572027520 00000100:00100000:2.0:1782727970.418769:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572027904 00000100:00100000:2.0:1782727970.418772:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572027904 00000100:00100000:2.0:1782727970.418934:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572027648 00000100:00100000:2.0:1782727970.418938:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572027648 00000100:00100000:2.0:1782727970.418956:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782727970.418964:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869325572027520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727970.419020:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869325572027520:12345-0@lo:400:kworker.0 Request processed in 56us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727970.419117:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782727970.419134:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782727970.419140:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d55c3688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869325572027904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727970.419171:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d55c3688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869325572027904:12345-0@lo:400:kworker.0 Request processed in 32us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727970.419177:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782727970.419189:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782727970.419194:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d55c3688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869325572027648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727970.419224:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d55c3688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869325572027648:12345-0@lo:400:kworker.0 Request processed in 30us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727970.419229:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782727970.419247:0:8323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572028032 00000100:00100000:2.0:1782727970.419251:0:8323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572028032 00000100:00100000:2.0:1782727970.419273:0:8323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572027776 00000100:00100000:2.0:1782727970.419276:0:8323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572027776 00000100:00100000:2.0:1782727970.419291:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782727970.419297:0:8323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572028032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727970.419325:0:8323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f55e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572028032:12345-0@lo:400:kworker.0 Request processed in 29us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727970.419331:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782727970.419341:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782727970.419346:0:8323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d55c368b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572027776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727970.419369:0:8323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d55c368b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572027776:12345-0@lo:400:kworker.0 Request processed in 24us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727970.419373:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1782727970.419408:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782727970.419412:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782727970.419414:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727970.419443:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1869325572027904:0@lo:400:kworker.0 00000100:00100000:2.0:1782727970.419454:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff74ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869325572027520:0@lo:400:kworker.0 00010000:00080000:2.0:1782727970.419465:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ff6edc00 x1869325572028032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727970.419475:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572028032:0@lo:400:kworker.0 00010000:00080000:2.0:1782727970.419542:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ff748380 x1869325572027776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727970.419551:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572027776:0@lo:400:kworker.0 00000100:00100000:2.0:1782727970.419559:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff74a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869325572027648:0@lo:400:kworker.0 00000100:00100000:0.0:1782727970.420564:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572027392 00000100:00100000:0.0:1782727970.420575:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572027392 00000100:00100000:0.0:1782727970.420616:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1782727970.420623:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3317:x1869325572027392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727970.421716:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3317:x1869325572027392:12345-0@lo:400:kworker.0 Request processed in 1087us (3135us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727970.421729:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1782727970.421959:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782727970.421974:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ffb10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572028160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727970.422103:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727970.422142:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572028160 00000100:00100000:0.0:1782727970.422148:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572028160 00000100:00100000:0.0:1782727970.422184:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782727970.422193:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ffb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572028160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727970.422229:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782727970.422270:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ffb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572028160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727970.422277:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1782727970.422327:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ffb10700 x1869325572028160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727970.422345:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ffb10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572028160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727970.423629:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c743bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3317:1869325572027392:0@lo:400:kworker.0 00010000:00010000:1.0:1782727970.797959:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727970.931153:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c3689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572028288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727970.931253:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727970.931339:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572028288 00000100:00100000:0.0:1782727970.931350:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572028288 00000100:00100000:0.0:1782727970.931409:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782727970.931418:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f44a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572028288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782727970.931453:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782727970.931560:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f44a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572028288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727970.931567:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1782727970.931615:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d55c3689f80 x1869325572028288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727970.931633:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c3689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572028288:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782727971.821733:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727972.063655:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727972.063718:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727972.063811:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552068864 00000100:00100000:3.0:1782727972.063834:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552068864 00000100:00100000:0.0:1782727972.064067:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552068992 00000100:00100000:0.0:1782727972.064072:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552068992 00000100:00100000:0.0:1782727972.064143:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 79 00000100:00100000:0.0:1782727972.064156:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d55c3689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2354:x1869325552068992:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782727972.064263:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d55c3689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2354:x1869325552068992:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 110us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727972.064271:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 79 00000100:00080000:1.0:1782727972.064356:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782727972.064409:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 216 00000100:00100000:3.0:1782727972.064419:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2354:x1869325552068864:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782727972.064450:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2354:x1869325552068864:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 34us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727972.064470:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 216 00010000:00010000:3.0:1782727972.846239:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727973.870665:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727974.896023:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727975.534342:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782727975.534375:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f44a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572028416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782727975.534483:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727975.538305:0:8059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572028416 00000100:00100000:0.0:1782727975.538326:0:8059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572028416 00000100:00100000:0.0:1782727975.538415:0:8059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782727975.538438:0:8059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f44a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572028416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727975.538504:0:8059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782727975.538639:0:8059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f44a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572028416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 205us (4155us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727975.538647:0:8059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1782727975.538710:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f44a4a80 x1869325572028416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727975.538738:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f44a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572028416:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782727975.539027:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727975.546537:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3317:1869325572028544:0@lo:400:kworker.0 00000100:00100000:3.0:1782727975.546635:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727975.546717:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572028544 00000100:00100000:3.0:1782727975.546726:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572028544 00000100:00100000:3.0:1782727975.546792:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1782727975.546802:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3317:x1869325572028544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727975.546863:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3317:x1869325572028544:12345-0@lo:400:kworker.0 Request processed in 61us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727975.546870:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1782727975.546944:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3317:1869325572028544:0@lo:400:kworker.0 00000100:00100000:3.0:1782727975.546995:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869325572028672:0@lo:400:kworker.0 00000100:00100000:3.0:1782727975.547025:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727975.547061:0:10280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572028672 00000100:00100000:3.0:1782727975.547065:0:10280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572028672 00000100:00100000:3.0:1782727975.547093:0:10280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782727975.547100:0:10280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869325572028672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727975.547134:0:10280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869325572028672:12345-0@lo:400:kworker.0 Request processed in 34us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727975.547140:0:10280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782727975.547183:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869325572028672:0@lo:400:kworker.0 00000100:00100000:3.0:1782727975.547215:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869325572028800:0@lo:400:kworker.0 00000100:00100000:3.0:1782727975.547240:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727975.547270:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572028800 00000100:00100000:3.0:1782727975.547274:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572028800 00000100:00100000:3.0:1782727975.547305:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782727975.547312:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869325572028800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727975.547347:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869325572028800:12345-0@lo:400:kworker.0 Request processed in 35us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727975.547353:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782727975.547389:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869325572028800:0@lo:400:kworker.0 00000100:00100000:3.0:1782727975.547421:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869325572028928:0@lo:400:kworker.0 00000100:00100000:3.0:1782727975.547456:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727975.547486:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572028928 00000100:00100000:3.0:1782727975.547490:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572028928 00000100:00100000:3.0:1782727975.547536:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782727975.547543:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869325572028928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727975.547579:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869325572028928:12345-0@lo:400:kworker.0 Request processed in 36us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727975.547585:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782727975.547610:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869325572028928:0@lo:400:kworker.0 00000100:00100000:3.0:1782727975.547644:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572029056:0@lo:400:kworker.0 00000100:00100000:3.0:1782727975.547672:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727975.547704:0:8323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572029056 00000100:00100000:3.0:1782727975.547708:0:8323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572029056 00000100:00100000:3.0:1782727975.547735:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782727975.547741:0:8323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572029056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727975.547776:0:8323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572029056:12345-0@lo:400:kworker.0 Request processed in 34us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727975.547781:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1782727975.547810:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f5cced80 x1869325572029056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727975.547822:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5cced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572029056:0@lo:400:kworker.0 00000100:00080000:1.0:1782727975.548248:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782727975.548255:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782727975.927914:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727976.049866:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c368a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572029184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782727976.049977:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727976.050250:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572029184 00000100:00100000:2.0:1782727976.050260:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572029184 00000100:00100000:2.0:1782727976.050325:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782727976.050336:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f44a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572029184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782727976.050381:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782727976.050436:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f44a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572029184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727976.050455:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1782727976.050539:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d55c368a300 x1869325572029184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727976.050560:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c368a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572029184:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782727976.946145:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727977.181933:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727977.182001:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727977.182094:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552069120 00000100:00100000:2.0:1782727977.182104:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552069120 00000100:00100000:2.0:1782727977.182165:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 218 00000100:00100000:2.0:1782727977.182176:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2355:x1869325552069120:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782727977.182245:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2355:x1869325552069120:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 72us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727977.182253:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 218 00000100:00100000:0.0:1782727977.184219:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552069248 00000100:00100000:0.0:1782727977.184229:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552069248 00000100:00100000:1.0:1782727977.184385:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 83 00000100:00100000:1.0:1782727977.184393:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2355:x1869325552069248:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782727977.184482:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2355:x1869325552069248:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 88us (2479us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727977.184489:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 83 00000100:00080000:2.0:1782727977.186006:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782727977.966260:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782727978.989717:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727980.015490:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727980.655874:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727980.655899:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ffb10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572029312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727980.655979:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727980.656041:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572029312 00000100:00100000:0.0:1782727980.656048:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572029312 00000100:00100000:0.0:1782727980.656098:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782727980.656106:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ffb11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572029312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782727980.656143:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782727980.656187:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ffb11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572029312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727980.656194:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1782727980.656214:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782727980.656242:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ffb10700 x1869325572029312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727996 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727980.656273:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ffb10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572029312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782727980.659767:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ffb13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869325572029696:0@lo:400:kworker.0 00000100:00100000:0.0:1782727980.659835:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727980.659872:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727980.659878:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ffb10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869325572029824:0@lo:400:kworker.0 00000100:00100000:0.0:1782727980.659894:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727980.659920:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572029696 00000100:00100000:0.0:1782727980.659927:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572029696 00000100:00100000:0.0:1782727980.659968:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572029824 00000100:00100000:0.0:1782727980.659971:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572029824 00000100:00100000:0.0:1782727980.659990:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1782727980.659997:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ffb11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869325572029696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727980.660043:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ffb11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869325572029696:12345-0@lo:400:kworker.0 Request processed in 46us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727980.660049:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1782727980.660062:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1782727980.660068:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ffb12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869325572029824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727980.660087:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ffb12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869325572029824:12345-0@lo:400:kworker.0 Request processed in 20us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727980.660092:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1782727980.660107:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782727980.660141:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ffb10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869325572029824:0@lo:400:kworker.0 00000100:00100000:0.0:1782727980.660149:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ffb13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869325572029696:0@lo:400:kworker.0 00000100:00100000:2.0:1782727980.660219:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ffb10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572029440:0@lo:400:kworker.0 00000100:00100000:2.0:1782727980.660251:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727980.660283:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ffb12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572029952:0@lo:400:kworker.0 00000100:00100000:2.0:1782727980.660305:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727980.660320:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782727980.660325:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ffb10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869325572029568:0@lo:400:kworker.0 00000100:00100000:2.0:1782727980.660340:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727980.660359:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572029952 00000100:00100000:2.0:1782727980.660362:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572029952 00000100:00100000:2.0:1782727980.660387:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782727980.660392:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d55c368a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572029952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727980.660435:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d55c368a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572029952:12345-0@lo:400:kworker.0 Request processed in 42us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727980.660440:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1782727980.660474:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ffb12680 x1869325572029952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782727996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727980.660485:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ffb12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572029952:0@lo:400:kworker.0 00000100:00100000:0.0:1782727980.660617:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572029440 00000100:00100000:0.0:1782727980.660625:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572029440 00000100:00100000:0.0:1782727980.660655:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1782727980.660661:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3316:x1869325572029440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727980.660692:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3316:x1869325572029440:12345-0@lo:400:kworker.0 Request processed in 32us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727980.660697:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:0.0:1782727980.660716:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782727980.660727:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ffb10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572029440:0@lo:400:kworker.0 00000100:00100000:1.0:1782727980.661311:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572029568 00000100:00100000:1.0:1782727980.661319:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572029568 00000100:00100000:1.0:1782727980.661357:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1782727980.661365:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d55c368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869325572029568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727980.661429:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d55c368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869325572029568:12345-0@lo:400:kworker.0 Request processed in 65us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727980.661435:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1782727980.663261:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ffb10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869325572029568:0@lo:400:kworker.0 00010000:00010000:3.0:1782727981.037819:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727981.166106:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f44a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572030080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782727981.166176:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782727981.166863:0:8059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572030080 00000100:00100000:1.0:1782727981.166873:0:8059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572030080 00000100:00100000:1.0:1782727981.166929:0:8059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782727981.166937:0:8059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d55c368bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572030080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782727981.166986:0:8059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782727981.167048:0:8059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d55c368bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572030080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727981.167055:0:8059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1782727981.167196:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f44a6680 x1869325572030080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782727997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727981.167215:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f44a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572030080:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782727982.063877:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727982.314878:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727982.314927:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727982.314957:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552069376 00000100:00100000:1.0:1782727982.314974:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552069376 00000100:00100000:1.0:1782727982.315029:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 220 00000100:00100000:1.0:1782727982.315039:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+10:2354:x1869325552069376:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782727982.315124:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+10:2354:x1869325552069376:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 73us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727982.315132:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 220 00000100:00100000:3.0:1782727982.315456:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552069504 00000100:00100000:3.0:1782727982.315461:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552069504 00000100:00100000:3.0:1782727982.315624:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 87 00000100:00100000:3.0:1782727982.315633:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f44a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2354:x1869325552069504:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782727982.315672:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f44a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2354:x1869325552069504:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 41us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727982.315679:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 87 00000100:00080000:1.0:1782727982.316209:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782727983.087220:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727984.109955:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782727984.283126:0:11208:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1782727985.133667:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727985.776172:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869325572030336:0@lo:400:kworker.0 00000100:00100000:3.0:1782727985.776273:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727985.776338:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572030848:0@lo:400:kworker.0 00000100:00100000:3.0:1782727985.776382:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727985.776416:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782727985.776423:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3315:1869325572030208:0@lo:400:kworker.0 00000100:00100000:3.0:1782727985.776455:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727985.776477:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869325572030720:0@lo:400:kworker.0 00000100:00100000:3.0:1782727985.776500:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727985.776553:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869325572030464:0@lo:400:kworker.0 00000100:00100000:3.0:1782727985.776602:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727985.776636:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782727985.776643:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572030592:0@lo:400:kworker.0 00000100:00100000:1.0:1782727985.776802:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572030336 00000100:00100000:1.0:1782727985.776814:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572030336 00000100:00100000:1.0:1782727985.776873:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572030720 00000100:00100000:1.0:1782727985.776876:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572030720 00000100:00100000:1.0:1782727985.776907:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572030464 00000100:00100000:1.0:1782727985.776910:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572030464 00000100:00100000:1.0:1782727985.776930:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782727985.776939:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff79f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869325572030336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727985.777012:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff79f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869325572030336:12345-0@lo:400:kworker.0 Request processed in 73us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727985.777021:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782727985.777041:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782727985.777046:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff79df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869325572030720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727985.777072:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff79df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869325572030720:12345-0@lo:400:kworker.0 Request processed in 26us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727985.777078:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782727985.777090:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1782727985.777095:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d9f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869325572030464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782727985.777119:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d9f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869325572030464:12345-0@lo:400:kworker.0 Request processed in 24us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727985.777133:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1782727985.777155:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727985.777196:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869325572030720:0@lo:400:kworker.0 00000100:00100000:1.0:1782727985.777206:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869325572030336:0@lo:400:kworker.0 00000100:00100000:2.0:1782727985.777381:0:8323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572030848 00000100:00100000:2.0:1782727985.777386:0:8323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572030848 00000100:00100000:2.0:1782727985.777425:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782727985.777431:0:8323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572030848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727985.777469:0:8323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff79f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572030848:12345-0@lo:400:kworker.0 Request processed in 39us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727985.777475:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782727985.777492:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782727985.777501:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c3689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572030976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727985.777556:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727985.777587:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572030976 00000100:00100000:2.0:1782727985.777590:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572030976 00000100:00100000:2.0:1782727985.777613:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782727985.777618:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c743bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572030976:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782727985.777799:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727985.777822:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869325572030464:0@lo:400:kworker.0 00000100:00100000:3.0:1782727985.777853:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572030208 00000100:00100000:3.0:1782727985.777856:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572030208 00000100:00100000:3.0:1782727985.777880:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1782727985.777886:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3315:x1869325572030208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727985.777915:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3315:x1869325572030208:12345-0@lo:400:kworker.0 Request processed in 29us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727985.777921:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1782727985.777948:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572030592 00000100:00100000:3.0:1782727985.777951:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572030592 00000100:00100000:3.0:1782727985.777968:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782727985.777973:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d9f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3316:x1869325572030592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727985.777997:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d9f5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3316:x1869325572030592:12345-0@lo:400:kworker.0 Request processed in 24us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727985.778003:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1782727985.778028:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f5ccce00 x1869325572030592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782728001 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727985.778040:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572030592:0@lo:400:kworker.0 00002000:00000024:2.0:1782727985.778775:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782727985.778838:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c743bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572030976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1218us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727985.778846:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1782727985.779917:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782727985.779927:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782727985.779971:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3315:1869325572030208:0@lo:400:kworker.0 00010000:00080000:1.0:1782727985.779990:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ff79f480 x1869325572030848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782728001 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727985.780003:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572030848:0@lo:400:kworker.0 00010000:00080000:3.0:1782727985.780106:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d55c3689f80 x1869325572030976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782728001 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727985.780130:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c3689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572030976:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782727986.157873:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727986.299878:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d9f5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572031104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727986.299977:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727986.300082:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572031104 00000100:00100000:3.0:1782727986.300093:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572031104 00000100:00100000:3.0:1782727986.300155:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782727986.300177:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d9f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572031104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727986.300227:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782727986.300281:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d9f5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572031104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727986.300290:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1782727986.300340:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56d9f5d880 x1869325572031104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782728002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727986.300375:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d9f5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572031104:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782727987.190550:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782727987.424758:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727987.424809:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782727987.424951:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552069632 00000100:00100000:0.0:1782727987.424961:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552069632 00000100:00100000:0.0:1782727987.425020:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 222 00000100:00100000:0.0:1782727987.425029:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+10:2355:x1869325552069632:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782727987.425104:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+10:2355:x1869325552069632:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 76us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727987.425111:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 222 00000100:00100000:2.0:1782727987.425252:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552069760 00000100:00100000:2.0:1782727987.425256:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552069760 00000100:00080000:3.0:1782727987.425401:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782727987.425455:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 91 00000100:00100000:2.0:1782727987.425464:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f44a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2355:x1869325552069760:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782727987.425499:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f44a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2355:x1869325552069760:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 38us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727987.425505:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 91 00000020:00000080:0.0:1782727987.936213:0:11356:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc21c13e30 20000000:00000080:0.0:1782727987.936232:0:11356:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d56f932b000 uarg=0000000000000000 20000000:01000000:0.0:1782727987.936272:0:11356:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782727987.936732:0:11356:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782727987.936738:0:11356:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1782727987.937924:0:11357:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1782727987.938119:0:11356:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1782727987.945130:0:11356:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782727987.945639:0:11356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d56dd3cf800/0x22171c6c29614e64 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727987.945662:0:11356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a36 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727987.945670:0:11356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d56c1666a00/0x22171c6c29614e41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614e3a expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727987.945677:0:11356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d56f94b1200/0x22171c6c29614e4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614e48 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727987.945684:0:11356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d56dd3cec00/0x22171c6c29614e5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614e56 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727987.945691:0:11356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d56dd3cf800/0x22171c6c29614e64 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727987.945737:0:11356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d56dd3cec00/0x22171c6c29614e5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22171c6c29614e56 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727987.945763:0:11356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d56dd3cec00/0x22171c6c29614e5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22171c6c29614e56 expref: 18 pid: 5800 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727987.945779:0:11356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff74a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11356:1869325572031232:0@lo:104: 00000100:00100000:2.0:1782727987.945846:0:11356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782727987.945904:0:11356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d56f94b1200/0x22171c6c29614e4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22171c6c29614e48 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727987.945913:0:11356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d56f94b1200/0x22171c6c29614e4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22171c6c29614e48 expref: 18 pid: 5800 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727987.945920:0:11356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff74ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11356:1869325572031360:0@lo:104: 00000100:00100000:2.0:1782727987.945944:0:11356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782727987.945967:0:11356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d56c1666a00/0x22171c6c29614e41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x22171c6c29614e3a expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727987.945974:0:11356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d56c1666a00/0x22171c6c29614e41 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x22171c6c29614e3a expref: 18 pid: 5801 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727987.945981:0:11356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6ec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11356:1869325572031488:0@lo:104: 00000100:00100000:2.0:1782727987.946016:0:11356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782727987.946038:0:11356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a36 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727987.946048:0:11356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a36 expref: 9 pid: 5801 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727987.946057:0:11356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff895880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11356:1869325572031616:192.168.202.31@tcp:104: 00000100:00100000:2.0:1782727987.946122:0:11356:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f94b9840 going to sleep for 11 seconds 00000100:00100000:0.0:1782727987.946294:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572031232 00000100:00100000:0.0:1782727987.946302:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572031232 00000100:00100000:0.0:1782727987.946361:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572031360 00000100:00100000:0.0:1782727987.946365:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572031360 00000100:00100000:0.0:1782727987.946375:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572031488 00000100:00100000:0.0:1782727987.946376:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572031488 00000100:00100000:0.0:1782727987.946389:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782727987.946397:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff748380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+5:11356:x1869325572031232:12345-0@lo:104: 00010000:00010000:0.0:1782727987.946409:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0e00/0x22171c6c29614e56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614e5d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.946479:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782727987.946485:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff748380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+5:11356:x1869325572031232:12345-0@lo:104: Request processed in 89us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727987.946492:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782727987.946535:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782727987.946542:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+4:11356:x1869325572031360:12345-0@lo:104: 00010000:00010000:0.0:1782727987.946550:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8d56f94b1800/0x22171c6c29614e48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614e4f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.946584:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782727987.946588:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+4:11356:x1869325572031360:12345-0@lo:104: Request processed in 48us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727987.946594:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782727987.946607:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782727987.946612:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff896680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+3:11356:x1869325572031488:12345-0@lo:104: 00010000:00010000:0.0:1782727987.946619:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0800/0x22171c6c29614e3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614e41 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.946664:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1782727987.946674:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff896680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+3:11356:x1869325572031488:12345-0@lo:104: Request processed in 62us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727987.946680:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1782727987.946697:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782727987.946702:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0e00/0x22171c6c29614e56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614e5d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.946709:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f94b0e00 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:0.0:1782727987.946712:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0e00/0x22171c6c29614e56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x22171c6c29614e5d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.946720:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0e00/0x22171c6c29614e56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x22171c6c29614e5d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727987.946726:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0e00/0x22171c6c29614e56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x22171c6c29614e5d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727987.946731:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782727987.946759:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0e00/0x22171c6c29614e56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614e5d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.946764:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727987.946785:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0e00/0x22171c6c29614e56 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614e5d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.946791:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0e00/0x22171c6c29614e56 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614e5d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.946802:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782727987.946805:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8d56f94b1800/0x22171c6c29614e48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614e4f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.946821:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f94b1800 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:0.0:1782727987.946824:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8d56f94b1800/0x22171c6c29614e48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x22171c6c29614e4f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.946830:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8d56f94b1800/0x22171c6c29614e48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x22171c6c29614e4f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727987.946835:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8d56f94b1800/0x22171c6c29614e48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x22171c6c29614e4f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727987.946839:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782727987.946852:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8d56f94b1800/0x22171c6c29614e48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614e4f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.946857:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727987.946863:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8d56f94b1800/0x22171c6c29614e48 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614e4f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.946868:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8d56f94b1800/0x22171c6c29614e48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614e4f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.946876:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782727987.946878:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0800/0x22171c6c29614e3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x22171c6c29614e41 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.946884:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f94b0800 already unused, calling callback (ffffffffc1b47c20) 10000000:00010000:0.0:1782727987.946886:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0800/0x22171c6c29614e3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x22171c6c29614e41 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.946902:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0800/0x22171c6c29614e3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x22171c6c29614e41 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782727987.946907:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0800/0x22171c6c29614e3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x22171c6c29614e41 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727987.946912:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782727987.946923:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0800/0x22171c6c29614e3a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614e41 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.946928:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782727987.946942:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0800/0x22171c6c29614e3a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614e41 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.946948:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8d56f94b0800/0x22171c6c29614e3a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x22171c6c29614e41 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.946959:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727987.946961:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727987.946962:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782727987.946968:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727987.946980:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ffb10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572031744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782727987.947020:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727987.947051:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782727987.947057:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ffb13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572031872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782727987.947078:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727987.947106:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572031744 00000100:00100000:0.0:1782727987.947110:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572031744 00010000:00010000:0.0:1782727987.947129:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d56dd3cec00/0x22171c6c29614e5d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614e56 expref: 19 pid: 5800 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727987.947156:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572031872 00000100:00100000:0.0:1782727987.947159:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572031872 00010000:00010000:0.0:1782727987.947170:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d56f94b1200/0x22171c6c29614e4f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614e48 expref: 20 pid: 5800 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727987.947186:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782727987.947192:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+20:3314:x1869325572031744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782727987.947202:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727987.947207:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d56dd3cec00/0x22171c6c29614e5d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614e56 expref: 20 pid: 5800 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.947217:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d56dd3cec00/0x22171c6c29614e5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22171c6c29614e56 expref: 20 pid: 5800 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.947233:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727987.947263:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+20:3314:x1869325572031744:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727987.947269:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782727987.947304:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782727987.947310:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ffb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3314:x1869325572031872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782727987.947316:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727987.947320:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d56f94b1200/0x22171c6c29614e4f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614e48 expref: 19 pid: 5800 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.947327:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d56f94b1200/0x22171c6c29614e4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22171c6c29614e48 expref: 19 pid: 5800 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.947336:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782727987.947372:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ffb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3314:x1869325572031872:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727987.947378:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782727987.947416:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ffb13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572031872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782727987.947423:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ffb10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572031744:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782727987.947816:0:11356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56dd3cec00/0x22171c6c29614e5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22171c6c29614e56 expref: 18 pid: 5800 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727987.947828:0:11356:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff74a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11356:1869325572031232:0@lo:104: 00010000:00010000:2.0:1782727987.947837:0:11356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56f94b1200/0x22171c6c29614e4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22171c6c29614e48 expref: 17 pid: 5800 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727987.947843:0:11356:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff74ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11356:1869325572031360:0@lo:104: 00000100:00100000:2.0:1782727987.947850:0:11356:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6ec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11356:1869325572031488:0@lo:104: 00000100:00100000:2.0:1782727987.948822:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ffb10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572032000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782727987.948883:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782727987.948944:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727987.951029:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572032000 00000100:00100000:3.0:1782727987.951044:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572032000 00010000:00010000:3.0:1782727987.951081:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d56c1666a00/0x22171c6c29614e41 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614e3a expref: 17 pid: 5801 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727987.951173:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1782727987.951182:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff896a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:3316:x1869325572032000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782727987.951197:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727987.951202:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d56c1666a00/0x22171c6c29614e41 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x22171c6c29614e3a expref: 17 pid: 5801 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727987.951215:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d56c1666a00/0x22171c6c29614e41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x22171c6c29614e3a expref: 17 pid: 5801 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727987.951232:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56c1666a00/0x22171c6c29614e41 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x22171c6c29614e3a expref: 17 pid: 5801 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727987.951248:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782727987.951446:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff896a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:3316:x1869325572032000:12345-0@lo:103:ldlm_bl.0 Request processed in 264us (2562us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727987.951480:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782727987.951947:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ffb10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572032000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782727987.959499:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782727987.959569:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552069888 00000100:00100000:0.0:1782727987.959578:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552069888 00010000:00010000:0.0:1782727987.959619:0:6620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e33 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a36 expref: 10 pid: 5801 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727987.959658:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 28 00000100:00100000:0.0:1782727987.959668:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f44a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b661aafc-708f-4f38-b71b-eec242d406b4+10:2352:x1869325552069888:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782727987.959683:0:6620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727987.959690:0:6620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e33 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a36 expref: 10 pid: 5801 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.959702:0:6620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a36 expref: 10 pid: 5801 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.959725:0:6620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d56dd3cf800/0x22171c6c29614e64 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.959735:0:6620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56dd3cf800/0x22171c6c29614e64 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.959751:0:6620:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d56dd3cf800/0x22171c6c29614e64 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.959767:0:6620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d56dd3cf800/0x22171c6c29614e64 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.959787:0:6620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d56dd3cf800/0x22171c6c29614e64 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727987.959792:0:11356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a36 expref: 10 pid: 5801 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.959794:0:6620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d56dd3cf800/0x22171c6c29614e64 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.959801:0:6620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3cf800 already unused, calling callback (ffffffffc152fcf0) 00010000:00010000:0.0:1782727987.959805:0:6620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d56dd3cf800/0x22171c6c29614e64 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727987.959808:0:11356:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff895880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11356:1869325572031616:192.168.202.31@tcp:104: 00010000:00010000:0.0:1782727987.959814:0:6620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d56dd3cf800/0x22171c6c29614e64 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.959822:0:6620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d56dd3cf800/0x22171c6c29614e64 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727987.959830:0:6620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782727987.959842:0:11356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d56dd3cf800/0x22171c6c29614e64 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727987.959850:0:11356:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d56dd3cf800/0x22171c6c29614e64 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727987.959856:0:11356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d56dd3cf800/0x22171c6c29614e64 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727987.959861:0:11356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d56dd3cf800/0x22171c6c29614e64 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727987.959885:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f44a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b661aafc-708f-4f38-b71b-eec242d406b4+9:2352:x1869325552069888:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 218us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727987.959893:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 28 00010000:00010000:3.0:1782727988.205843:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727989.151155:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727989.151797:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552070016 00000100:00100000:1.0:1782727989.151808:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552070016 00000100:00100000:1.0:1782727989.151867:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 223 00000100:00100000:1.0:1782727989.151877:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+9:5568:x1869325552070016:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782727989.151895:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727989.151915:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56f94b0400/0x22171c6c29614e6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44e8af495f20a3d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727989.151943:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56f94b0400/0x22171c6c29614e6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a3d expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727989.151970:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56f94b0400/0x22171c6c29614e6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a3d expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727989.151991:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f94b0400, rc 0) 00000100:00100000:1.0:1782727989.152058:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+10:5568:x1869325552070016:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 Request processed in 182us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727989.152066:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 223 00000100:00100000:1.0:1782727989.159410:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727989.160847:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552070144 00000100:00100000:2.0:1782727989.160861:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552070144 00000100:00100000:2.0:1782727989.160913:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 224 00000100:00100000:2.0:1782727989.160923:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:5568:x1869325552070144:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727989.161207:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:5568:x1869325552070144:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 Request processed in 285us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727989.161215:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 224 00000100:00100000:3.0:1782727989.164001:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727989.164392:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552070272 00000100:00100000:1.0:1782727989.164402:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552070272 00000100:00100000:1.0:1782727989.164494:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 225 00000100:00100000:1.0:1782727989.164504:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+10:5568:x1869325552070272:12345-192.168.202.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782727989.164783:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+10:5568:x1869325552070272:12345-192.168.202.31@tcp:503:ll_cfg_requeue.0 Request processed in 279us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727989.164790:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 225 00010000:00010000:0.0:1782727989.230599:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782727989.496146:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782727989.496154:0:5803:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8d56d9e79800 from 7 10000000:01000000:3.0:1782727989.496159:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782727989.496207:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56c1666a00/0x22171c6c29614e72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727989.496220:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d56c1666a00/0x22171c6c29614e72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727989.496231:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d56c1666a00/0x22171c6c29614e72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727989.496264:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d9f5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572032128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782727989.496351:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727989.496419:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d9f05180 going to sleep for 11 seconds 00000100:00100000:2.0:1782727989.496782:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572032128 00000100:00100000:2.0:1782727989.496790:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572032128 00000100:00100000:2.0:1782727989.496847:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1782727989.496856:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+16:5803:x1869325572032128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727989.496869:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727989.496882:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614e72 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727989.496906:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614e72 expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727989.496916:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56dd3ce800/0x22171c6c29614e79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614e72 expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727989.496926:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3ce800, rc 0) 00000100:00100000:2.0:1782727989.496980:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:5803:x1869325572032128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727989.496986:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1782727989.497247:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d9f5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572032128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727989.497262:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d56c1666a00/0x22171c6c29614e72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614e79 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727989.497270:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d56c1666a00/0x22171c6c29614e72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614e79 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727989.497339:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ffb10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572032256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727989.497383:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727989.497418:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f44b6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782727989.497482:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572032256 00000100:00100000:3.0:1782727989.497487:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572032256 00000100:00100000:3.0:1782727989.497545:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1782727989.497552:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:5803:x1869325572032256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727989.498191:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:5803:x1869325572032256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 637us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727989.498199:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1782727989.498278:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ffb10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572032256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727989.498313:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ffb10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572032384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727989.498363:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727989.498395:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f44b6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782727989.498453:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572032384 00000100:00100000:2.0:1782727989.498464:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572032384 00000100:00100000:2.0:1782727989.498500:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1782727989.498528:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:5803:x1869325572032384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727989.498809:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:5803:x1869325572032384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 301us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727989.498816:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1782727989.498898:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ffb10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572032384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782727989.500012:0:11412:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1782727989.500284:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1782727989.500304:0:5803:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782727989.500315:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56c1666a00/0x22171c6c29614e72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614e79 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727989.500334:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d56c1666a00/0x22171c6c29614e72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614e79 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782727989.500345:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782727989.500348:0:5803:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8d56c75cf800 from 7 10000000:01000000:2.0:1782727989.500350:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782727989.500379:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cec00/0x22171c6c29614e80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727989.500388:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cec00/0x22171c6c29614e80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727989.500397:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cec00/0x22171c6c29614e80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727989.500419:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff895880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572032512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782727989.500469:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727989.500531:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f94b9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782727989.500668:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572032512 00000100:00100000:0.0:1782727989.500674:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572032512 00000100:00100000:0.0:1782727989.500711:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1782727989.500719:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+17:5803:x1869325572032512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782727989.500730:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727989.500752:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56c0031600/0x22171c6c29614e87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614e80 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727989.500775:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56c0031600/0x22171c6c29614e87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614e80 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727989.500786:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56c0031600/0x22171c6c29614e87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614e80 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727989.500793:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56c0031600, rc 0) 00000100:00100000:0.0:1782727989.500830:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:5803:x1869325572032512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727989.500836:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1782727989.500963:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff895880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572032512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727989.500985:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cec00/0x22171c6c29614e80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614e87 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727989.500993:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cec00/0x22171c6c29614e80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614e87 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727989.501036:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff895880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572032640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727989.501059:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727989.501087:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f94b9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782727989.502794:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572032640 00000100:00100000:0.0:1782727989.502814:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572032640 00000100:00100000:0.0:1782727989.502864:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1782727989.502873:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d08aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:5803:x1869325572032640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727989.503302:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d08aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:5803:x1869325572032640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 430us (2240us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727989.503310:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1782727989.503803:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff895880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572032640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782727989.503852:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff895880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572032768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782727989.503901:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727989.503938:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f94b9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782727989.504070:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572032768 00000100:00100000:0.0:1782727989.504075:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572032768 00000100:00100000:0.0:1782727989.504116:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1782727989.504125:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0877050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:5803:x1869325572032768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727989.504275:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0877050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:5803:x1869325572032768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727989.504282:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1782727989.504765:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff895880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572032768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782727989.506495:0:11413:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1782727989.511842:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1782727989.511880:0:5803:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782727989.511894:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cec00/0x22171c6c29614e80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614e87 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727989.511906:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d56dd3cec00/0x22171c6c29614e80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614e87 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782727989.511919:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782727989.511921:0:5803:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8d56c8fb6000 from 7 10000000:01000000:0.0:1782727989.511924:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782727989.511965:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56c0030000/0x22171c6c29614e8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727989.511975:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8d56c0030000/0x22171c6c29614e8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727989.512000:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8d56c0030000/0x22171c6c29614e8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727989.512024:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ffb10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572032896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782727989.512086:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727989.512229:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f44b6180 going to sleep for 11 seconds 00000100:00100000:2.0:1782727989.516257:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572032896 00000100:00100000:2.0:1782727989.516271:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572032896 00000100:00100000:2.0:1782727989.516387:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1782727989.516399:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0875c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+18:5803:x1869325572032896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782727989.516416:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727989.516434:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d56dd3cfe00/0x22171c6c29614e95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x22171c6c29614e8e expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727989.516464:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d56dd3cfe00/0x22171c6c29614e95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x22171c6c29614e8e expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727989.516476:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d56dd3cfe00/0x22171c6c29614e95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x22171c6c29614e8e expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727989.516493:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3cfe00, rc 0) 00000100:00100000:2.0:1782727989.516609:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0875c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:5803:x1869325572032896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (4522us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727989.516617:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1782727989.516724:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ffb10700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572032896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782727989.516743:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8d56c0030000/0x22171c6c29614e8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614e95 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727989.516761:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8d56c0030000/0x22171c6c29614e8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x22171c6c29614e95 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727989.516834:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d9f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572033024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727989.516867:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727989.521982:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d9f053c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727989.526621:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572033024 00000100:00100000:0.0:1782727989.526647:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572033024 00000100:00100000:0.0:1782727989.526859:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1782727989.526870:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0876050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:5803:x1869325572033024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782727989.527186:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0876050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:5803:x1869325572033024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 317us (10317us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727989.527195:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1782727989.527494:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d9f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572033024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782727989.527571:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d9f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572033152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782727989.527619:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727989.527646:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d9f053c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782727989.527761:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572033152 00000100:00100000:0.0:1782727989.527767:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572033152 00000100:00100000:0.0:1782727989.527795:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1782727989.527801:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:5803:x1869325572033152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782727989.527945:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0876c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:5803:x1869325572033152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727989.527952:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1782727989.528017:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d9f5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:5803:1869325572033152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782727989.529314:0:11414:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1782727989.530482:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1782727989.530505:0:5803:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782727989.530862:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8d56c0030000/0x22171c6c29614e8e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614e95 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727989.530876:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8d56c0030000/0x22171c6c29614e8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x22171c6c29614e95 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727990.258101:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782727990.896941:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572033664:0@lo:400:kworker.0 00000100:00100000:2.0:1782727990.897007:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727990.897064:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782727990.897071:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572033280:0@lo:400:kworker.0 00000100:00100000:2.0:1782727990.897098:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727990.897119:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869325572033792:0@lo:400:kworker.0 00000100:00100000:2.0:1782727990.897143:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727990.897170:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869325572033536:0@lo:400:kworker.0 00000100:00100000:2.0:1782727990.897192:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727990.897211:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782727990.897216:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869325572033408:0@lo:400:kworker.0 00000100:00100000:2.0:1782727990.897250:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727990.897265:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572033920:0@lo:400:kworker.0 00000100:00100000:3.0:1782727990.897434:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572033280 00000100:00100000:3.0:1782727990.897443:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572033280 00000100:00100000:3.0:1782727990.897491:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1782727990.897500:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3316:x1869325572033280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727990.897575:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0877c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3316:x1869325572033280:12345-0@lo:400:kworker.0 Request processed in 75us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727990.897597:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1782727990.897719:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727990.897749:0:8323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572033664 00000100:00100000:2.0:1782727990.897753:0:8323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572033664 00000100:00100000:2.0:1782727990.897787:0:8323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572033920 00000100:00100000:2.0:1782727990.897790:0:8323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572033920 00000100:00100000:2.0:1782727990.897809:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782727990.897816:0:8323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572033664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727990.897849:0:8323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572033664:12345-0@lo:400:kworker.0 Request processed in 34us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727990.897864:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782727990.897879:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782727990.897885:0:8323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572033920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727990.897920:0:8323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572033920:12345-0@lo:400:kworker.0 Request processed in 35us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727990.897926:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782727990.897942:0:10280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572033792 00000100:00100000:2.0:1782727990.897946:0:10280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572033792 00000100:00100000:2.0:1782727990.897969:0:10280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572033536 00000100:00100000:2.0:1782727990.897972:0:10280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572033536 00000100:00100000:2.0:1782727990.897989:0:10280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572033408 00000100:00100000:2.0:1782727990.897991:0:10280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572033408 00000100:00100000:2.0:1782727990.898004:0:10280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1782727990.898010:0:10280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869325572033792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727990.898037:0:10280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869325572033792:12345-0@lo:400:kworker.0 Request processed in 27us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727990.898043:0:10280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1782727990.898053:0:10280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782727990.898060:0:10280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869325572033536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727990.898102:0:10280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869325572033536:12345-0@lo:400:kworker.0 Request processed in 43us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727990.898108:0:10280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782727990.898119:0:10280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782727990.898124:0:10280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869325572033408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727990.898149:0:10280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869325572033408:12345-0@lo:400:kworker.0 Request processed in 25us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727990.898164:0:10280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1782727990.898417:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782727990.898422:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782727990.898424:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782727990.898457:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572033280:0@lo:400:kworker.0 00000100:00100000:3.0:1782727990.898472:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869325572033792:0@lo:400:kworker.0 00010000:00080000:3.0:1782727990.898484:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ff895180 x1869325572033664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782728006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727990.898495:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572033664:0@lo:400:kworker.0 00000100:00100000:2.0:1782727990.898697:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869325572033408:0@lo:400:kworker.0 00010000:00080000:2.0:1782727990.898710:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ff895c00 x1869325572033920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782728006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727990.898720:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572033920:0@lo:400:kworker.0 00000100:00100000:2.0:1782727990.898729:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869325572033536:0@lo:400:kworker.0 00000100:00100000:2.0:1782727990.900495:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f44a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572034048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727990.900586:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727990.902617:0:8059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572034048 00000100:00100000:3.0:1782727990.902631:0:8059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572034048 00000100:00100000:3.0:1782727990.902682:0:8059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782727990.902694:0:8059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff897b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572034048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727990.902739:0:8059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782727990.906625:0:8059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff897b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572034048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3922us (6027us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727990.906639:0:8059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1782727990.906797:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f44a7b80 x1869325572034048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782728006 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782727990.906827:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f44a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572034048:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782727991.277643:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727991.405698:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782727991.405723:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d9f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572034176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782727991.405804:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727991.405869:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572034176 00000100:00100000:3.0:1782727991.405877:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572034176 00000100:00100000:3.0:1782727991.405927:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782727991.405936:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d9f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572034176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727991.405980:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782727991.406041:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d9f5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572034176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727991.406049:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1782727991.406095:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56d9f5ce00 x1869325572034176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782728007 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782727991.406114:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d9f5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572034176:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1782727991.487692:0:11553:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg231-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1782727992.305181:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727992.542172:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727992.542294:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782727992.542544:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552070400 00000100:00100000:0.0:1782727992.542555:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552070400 00000100:00100000:0.0:1782727992.542633:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 236 00000100:00100000:0.0:1782727992.542644:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0874c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2354:x1869325552070400:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782727992.542740:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0874c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2354:x1869325552070400:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 97us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727992.542749:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 236 00000100:00100000:2.0:1782727992.546867:0:10280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552070528 00000100:00100000:2.0:1782727992.546884:0:10280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552070528 00000100:00100000:2.0:1782727992.547047:0:10280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 95 00000100:00100000:2.0:1782727992.547058:0:10280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d9f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2354:x1869325552070528:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782727992.547157:0:10280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d9f5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2354:x1869325552070528:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 100us (4993us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727992.547165:0:10280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 95 00000100:00080000:3.0:1782727992.548874:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782727993.326064:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782727994.349775:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782727995.266995:0:11653:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity: finish setup 06:13:14 (1782727994) === 00010000:00010000:2.0:1782727995.373698:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727995.401301:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727995.409858:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552070656 00000100:00100000:2.0:1782727995.409873:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552070656 00000100:00100000:2.0:1782727995.409954:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 10 00000100:00100000:2.0:1782727995.409965:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ffb13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:7615:x1869325552070656:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1782727995.409996:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727995.410049:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c29614e9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20a44 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.410118:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614ea3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.410132:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.410142:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.410156:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614eaa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.410162:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614eaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.410169:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614eaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782727995.410820:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782727995.411712:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.411724:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614ea3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.411730:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614ea3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.411737:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3cf200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1782727995.411752:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614ea3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.411759:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614ea3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.411775:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d03b0000) 00010000:00010000:2.0:1782727995.411778:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727995.411782:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614ea3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.411788:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614ea3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.411801:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614eaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.411808:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614eaa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.411814:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614eaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.411819:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3cee00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1782727995.411821:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614eaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.411827:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614eaa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.411834:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x54ef8a6e (ffff8d56c9dbb800) 00010000:00010000:2.0:1782727995.411836:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727995.411845:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614eaa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.411851:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614eaa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x54ef8a6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.411894:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c29614e9c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a44 expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.411905:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d03b0000) 00010000:00010000:2.0:1782727995.411908:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782727995.411911:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c29614e9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a44 expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.411920:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3cf400, rc 0) 00000100:00100000:2.0:1782727995.416623:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ffb13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:7615:x1869325552070656:12345-192.168.202.31@tcp:101:bash.0 Request processed in 6644us (15316us total) trans 0 rc 301/301 00000100:00100000:2.0:1782727995.416637:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 10 00000100:00100000:0.0:1782727995.421482:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727995.421802:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552070784 00000100:00100000:2.0:1782727995.421812:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552070784 00000100:00100000:2.0:1782727995.421878:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 11 00000100:00100000:2.0:1782727995.421888:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ffb12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:7615:x1869325552070784:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1782727995.421909:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727995.421930:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c29614eb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20a4b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.421996:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614eb8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.422026:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614eb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.422038:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614eb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.422052:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614ebf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.422059:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614ebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.422066:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614ebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.422347:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614eb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.422357:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614eb8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.422364:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614eb8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.422370:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3cee00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1782727995.422374:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614eb8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.422382:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614eb8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.422395:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d03b0000) 00010000:00010000:2.0:1782727995.422404:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727995.422409:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614eb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.422416:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614eb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.422427:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614ebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.422434:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614ebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.422440:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614ebf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.422445:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3cf200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1782727995.422448:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614ebf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.422454:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614ebf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.422461:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x77bdd2c7 (ffff8d56c9dbb800) 00010000:00010000:2.0:1782727995.422464:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727995.422466:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614ebf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.422472:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614ebf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x77bdd2c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.422504:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c29614eb1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a4b expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.422555:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d03b0000) 00010000:00010000:2.0:1782727995.422558:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782727995.422574:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c29614eb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a4b expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.422585:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3cf400, rc 0) 00000100:00100000:2.0:1782727995.422648:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ffb12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:7615:x1869325552070784:12345-192.168.202.31@tcp:101:bash.0 Request processed in 761us (1174us total) trans 0 rc 301/301 00000100:00100000:2.0:1782727995.422657:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 11 00000100:00100000:3.0:1782727995.432334:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782727995.436677:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552070912 00000100:00100000:0.0:1782727995.436691:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552070912 00000100:00100000:0.0:1782727995.436767:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1 00000100:00100000:0.0:1782727995.436778:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d9f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:7615:x1869325552070912:12345-192.168.202.31@tcp:37:bash.0 00000100:00100000:1.0:1782727995.450374:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d9f5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:7615:x1869325552070912:12345-192.168.202.31@tcp:37:bash.0 Request processed in 13586us (18038us total) trans 0 rc 0/0 00000100:00100000:1.0:1782727995.450393:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1 00000100:00100000:0.0:1782727995.468891:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727995.468975:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552071040 00000100:00100000:1.0:1782727995.468986:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552071040 00000100:00100000:1.0:1782727995.469056:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 12 00000100:00100000:1.0:1782727995.469067:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ffb11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:10399:x1869325552071040:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:1.0:1782727995.469099:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782727995.469122:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0a00/0x22171c6c29614ec6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20a52 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.469194:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1a00/0x22171c6c29614ecd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.469208:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1a00/0x22171c6c29614ecd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.469219:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1a00/0x22171c6c29614ecd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.469297:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1400/0x22171c6c29614ed4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.469306:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1400/0x22171c6c29614ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.469313:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1400/0x22171c6c29614ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.471382:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1a00/0x22171c6c29614ecd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.471397:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1a00/0x22171c6c29614ecd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.471404:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1a00/0x22171c6c29614ecd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.471411:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f94b1a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1782727995.471425:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1a00/0x22171c6c29614ecd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.471432:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1a00/0x22171c6c29614ecd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.471451:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d03b0000) 00010000:00010000:1.0:1782727995.471454:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727995.471458:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1a00/0x22171c6c29614ecd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.471465:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1a00/0x22171c6c29614ecd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.471478:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1400/0x22171c6c29614ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.471484:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1400/0x22171c6c29614ed4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.471490:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1400/0x22171c6c29614ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.471494:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f94b1400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1782727995.471497:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1400/0x22171c6c29614ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.471502:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1400/0x22171c6c29614ed4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.471525:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3d64192e (ffff8d56d03b0d00) 00010000:00010000:1.0:1782727995.471528:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727995.471537:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1400/0x22171c6c29614ed4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.471544:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1400/0x22171c6c29614ed4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3d64192e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.471867:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0a00/0x22171c6c29614ec6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a52 expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.471881:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d03b0000) 00010000:00010000:1.0:1782727995.471884:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727995.471888:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0a00/0x22171c6c29614ec6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a52 expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.471899:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f94b0a00, rc 0) 00000100:00100000:1.0:1782727995.472041:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ffb11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:10399:x1869325552071040:12345-192.168.202.31@tcp:101:rm.0 Request processed in 2974us (3159us total) trans 0 rc 301/301 00000100:00100000:1.0:1782727995.472050:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 12 00000100:00100000:3.0:1782727995.566495:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727995.566553:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782727995.567520:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552071296 00000100:00100000:0.0:1782727995.567531:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552071296 00000100:00100000:0.0:1782727995.567743:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 0 00000100:00100000:0.0:1782727995.567754:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d9f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:10406:x1869325552071296:12345-192.168.202.31@tcp:700:mkdir.0 00000100:00100000:0.0:1782727995.567842:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d9f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:10406:x1869325552071296:12345-192.168.202.31@tcp:700:mkdir.0 Request processed in 90us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727995.567849:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 0 00000100:00100000:3.0:1782727995.572210:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552071168 00000100:00100000:3.0:1782727995.572222:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552071168 00000100:00100000:3.0:1782727995.572297:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 13 00000100:00100000:3.0:1782727995.572307:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d9f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2355:x1869325552071168:12345-192.168.202.31@tcp:41:mkdir.0 00000004:00000024:3.0:1782727995.572348:0:5806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1782727995.572432:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d9f5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2355:x1869325552071168:12345-192.168.202.31@tcp:41:mkdir.0 Request processed in 127us (5948us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727995.572440:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 13 00000100:00100000:0.0:1782727995.593730:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782727995.593769:0:10280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552071552 00000100:00100000:0.0:1782727995.593778:0:10280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552071552 00000100:00100000:0.0:1782727995.593836:0:10280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 14 00000100:00100000:0.0:1782727995.593847:0:10280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ffb11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:10406:x1869325552071552:12345-192.168.202.31@tcp:36:mkdir.0 00010000:00010000:0.0:1782727995.593911:0:10280:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782727995.593942:0:10280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0000/0x22171c6c29614dae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a21 expref: 6 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.593978:0:10280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d03b0000) 00010000:00010000:0.0:1782727995.593988:0:10280:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727995.594267:0:10280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614edb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.594294:0:10280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614edb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.594303:0:10280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614edb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.594378:0:10280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c29614ee2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.594386:0:10280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c29614ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.594393:0:10280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c29614ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727995.595788:0:10280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1782727995.595806:0:10280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614edb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.595814:0:10280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614edb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.595821:0:10280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614edb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.595827:0:10280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56c0031400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1782727995.595837:0:10280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614edb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.595846:0:10280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614edb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.595861:0:10280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d830bc00) 00010000:00010000:0.0:1782727995.595864:0:10280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727995.595868:0:10280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614edb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.595874:0:10280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614edb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782727995.595895:0:10280:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000007c1d523 reply state 000000008835a8f3 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c29614ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727995.595905:0:10280:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782727995.596007:0:10280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ffb11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:10406:x1869325552071552:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 2159us (2285us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1782727995.596017:0:10280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 14 00010000:00010000:1.0:1782727995.603820:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c29614ee2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.603840:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c29614ee2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.603850:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c29614ee2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.603857:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56c0030800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1782727995.603863:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c29614ee2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.603888:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c29614ee2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.603906:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d56d830b400) 00010000:00010000:1.0:1782727995.603909:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727995.603914:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c29614ee2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.603920:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c29614ee2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727995.612763:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727995.613034:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552071680 00000100:00100000:2.0:1782727995.613044:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552071680 00000100:00100000:2.0:1782727995.613099:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 15 00000100:00100000:2.0:1782727995.613109:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f44a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:10407:x1869325552071680:12345-192.168.202.31@tcp:101:chmod.0 00010000:00010000:2.0:1782727995.613130:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727995.613152:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614ee9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20a59 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.613221:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614ef0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.613235:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.613245:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727995.613324:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1782727995.613337:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727995.613385:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.613414:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614ee9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a59 expref: 8 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.613431:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a59 expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.613441:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c9dbba00) 00010000:00010000:2.0:1782727995.613444:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782727995.613448:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3cee00, rc 0) 00000100:00100000:2.0:1782727995.613545:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f44a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:10407:x1869325552071680:12345-192.168.202.31@tcp:101:chmod.0 Request processed in 435us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727995.613552:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 15 00000100:00100000:0.0:1782727995.622364:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782727995.622441:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552071936 00000100:00100000:1.0:1782727995.622452:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552071936 00000100:00100000:1.0:1782727995.622528:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 16 00000100:00100000:1.0:1782727995.622539:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ffb12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:10407:x1869325552071936:12345-192.168.202.31@tcp:36:chmod.0 00010000:00010000:1.0:1782727995.622771:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782727995.622799:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614ef0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a59 expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.622819:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c9dbba00) 00010000:00010000:1.0:1782727995.622830:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782727995.622856:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1400/0x22171c6c29614ef7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.622869:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1400/0x22171c6c29614ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.622878:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1400/0x22171c6c29614ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782727995.623185:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000780bb25f reply state 000000007b8e54d5 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1400/0x22171c6c29614ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727995.623194:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782727995.623209:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1782727995.623307:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ffb12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:10407:x1869325552071936:12345-192.168.202.31@tcp:36:chmod.0 Request processed in 769us (952us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1782727995.623315:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 16 00010000:00010000:0.0:1782727995.634744:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1400/0x22171c6c29614ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.634762:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1400/0x22171c6c29614ef7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.634770:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1400/0x22171c6c29614ef7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.634777:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f94b1400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1782727995.634788:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1400/0x22171c6c29614ef7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.634795:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1400/0x22171c6c29614ef7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.634812:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d03b0d00) 00010000:00010000:0.0:1782727995.634815:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782727995.634820:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1400/0x22171c6c29614ef7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.634827:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1400/0x22171c6c29614ef7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727995.656378:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727995.656465:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552072064 00000100:00100000:3.0:1782727995.656476:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552072064 00000100:00100000:3.0:1782727995.657067:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 17 00000100:00100000:3.0:1782727995.657079:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ffb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:10408:x1869325552072064:12345-192.168.202.31@tcp:101:chown.0 00010000:00010000:3.0:1782727995.657103:0:7031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727995.657139:0:7031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1666600/0x22171c6c29614efe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20a60 expref: -99 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.657207:0:7031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1667000/0x22171c6c29614f05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.657221:0:7031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1667000/0x22171c6c29614f05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.657234:0:7031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1667000/0x22171c6c29614f05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782727995.657312:0:7031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1782727995.657316:0:7031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1782727995.657354:0:7031:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1667000/0x22171c6c29614f05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.657380:0:7031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1666600/0x22171c6c29614efe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a60 expref: 9 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.657396:0:7031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1667000/0x22171c6c29614f05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a60 expref: 8 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.657405:0:7031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c4d03200) 00010000:00010000:3.0:1782727995.657408:0:7031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782727995.657411:0:7031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56c1667000, rc 0) 00000100:00100000:3.0:1782727995.657601:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ffb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:10408:x1869325552072064:12345-192.168.202.31@tcp:101:chown.0 Request processed in 525us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727995.657610:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 17 00000100:00100000:0.0:1782727995.667483:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727995.669620:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552072192 00000100:00100000:2.0:1782727995.669635:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552072192 00000100:00100000:2.0:1782727995.669716:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 18 00000100:00100000:2.0:1782727995.669727:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ffb11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:10408:x1869325552072192:12345-192.168.202.31@tcp:101:chown.0 00010000:00010000:2.0:1782727995.669750:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727995.669774:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614f0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20a67 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.669846:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29614f13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.669869:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29614f13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.669898:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29614f13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.669914:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c29614f1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.669922:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c29614f1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.669929:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c29614f1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.670031:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29614f21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.670039:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29614f21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.670045:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29614f21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727995.670082:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1782727995.670086:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727995.670112:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29614f21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.670124:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29614f13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.670131:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29614f13 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.670148:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29614f13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.670155:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3ce400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1782727995.670159:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29614f13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.670166:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29614f13 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.670178:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c4d03200) 00010000:00010000:2.0:1782727995.670181:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727995.670186:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29614f13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.670191:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29614f13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.670205:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c29614f1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.670211:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c29614f1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.670216:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c29614f1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.670221:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3cfa00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1782727995.670223:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c29614f1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.670237:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c29614f1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.670244:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d56c9dbbd00) 00010000:00010000:2.0:1782727995.670246:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727995.670249:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c29614f1a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.670254:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c29614f1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.670296:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614f0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a67 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.670308:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29614f21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a67 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.670315:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d56c9dbb700) 00010000:00010000:2.0:1782727995.670317:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782727995.670319:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3cf800, rc 0) 00000100:00100000:2.0:1782727995.670700:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ffb11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+9:10408:x1869325552072192:12345-192.168.202.31@tcp:101:chown.0 Request processed in 972us (3226us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727995.670708:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 18 00000100:00100000:1.0:1782727995.679783:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727995.679867:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552072448 00000100:00100000:2.0:1782727995.679879:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552072448 00000100:00100000:2.0:1782727995.679943:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 19 00000100:00100000:2.0:1782727995.679953:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f44a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+9:10408:x1869325552072448:12345-192.168.202.31@tcp:36:chown.0 00010000:00010000:2.0:1782727995.680014:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782727995.680055:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29614f21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a67 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.680072:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d56c9dbb700) 00010000:00010000:2.0:1782727995.680083:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782727995.680111:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29614f28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.680125:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29614f28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.680136:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29614f28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782727995.720553:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:2.0:1782727995.720583:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:2.0:1782727995.720593:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1782727995.720652:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007f86f4df reply state 0000000095c35747 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29614f28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727995.720698:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782727995.721442:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:3.0:1782727995.721628:0:5808:0:(ldlm_lib.c:3443:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1782727995.721655:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f44a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:10408:x1869325552072448:12345-192.168.202.31@tcp:36:chown.0 Request processed in 41695us (41875us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1782727995.721667:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 19 00010000:00010000:1.0:1782727995.722060:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29614f28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.722077:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29614f28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.722085:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29614f28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.722092:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3cf000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1782727995.722097:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29614f28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.722104:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29614f28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.722121:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d56c9dbb800) 00010000:00010000:1.0:1782727995.722124:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782727995.722129:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29614f28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.722152:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29614f28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727995.746411:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727995.746500:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552072576 00000100:00100000:3.0:1782727995.746570:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552072576 00000100:00100000:2.0:1782727995.746799:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 20 00000100:00100000:2.0:1782727995.746814:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f44a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:10409:x1869325552072576:12345-192.168.202.31@tcp:101:touch.500 00010000:00010000:2.0:1782727995.746848:0:7031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727995.746877:0:7031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29614f2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20a6e expref: -99 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782727995.749361:0:7031:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2414us 00010000:00010000:0.0:1782727995.778844:0:7031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614f36 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.778867:0:7031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614f36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.778880:0:7031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614f36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.778898:0:7031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614f3d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.778904:0:7031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614f3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.778911:0:7031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614f3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.779397:0:7031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c29614f44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.779408:0:7031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c29614f44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.779417:0:7031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c29614f44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727995.779501:0:7031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782727995.779505:0:7031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782727995.779650:0:7031:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c29614f44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.779663:0:7031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614f36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.779669:0:7031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614f36 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.779676:0:7031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614f36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.779682:0:7031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56c0031800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1782727995.779686:0:7031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614f36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.779693:0:7031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614f36 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.779706:0:7031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c4d03200) 00010000:00010000:0.0:1782727995.779714:0:7031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727995.779719:0:7031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614f36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.779725:0:7031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614f36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.779739:0:7031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614f3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.779744:0:7031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614f3d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.779749:0:7031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614f3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.779754:0:7031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56c0031400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1782727995.779757:0:7031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614f3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.779762:0:7031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614f3d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.779769:0:7031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d56d830b200) 00010000:00010000:0.0:1782727995.779772:0:7031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727995.779775:0:7031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614f3d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.779780:0:7031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614f3d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.779820:0:7031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29614f2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a6e expref: 8 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.779849:0:7031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c29614f44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a6e expref: 7 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727995.779857:0:7031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d56d830bc00) 00010000:00010000:0.0:1782727995.779859:0:7031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782727995.779862:0:7031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56c0030800, rc 0) 00000100:00100000:0.0:1782727995.779944:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f44a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:10409:x1869325552072576:12345-192.168.202.31@tcp:101:touch.500 Request processed in 33133us (33540us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727995.779953:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 20 00000100:00100000:0.0:1782727995.793852:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727995.795448:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552072832 00000100:00100000:2.0:1782727995.795462:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552072832 00000100:00100000:3.0:1782727995.798180:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 21 00000100:00100000:3.0:1782727995.798197:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ffb13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:10409:x1869325552072832:12345-192.168.202.31@tcp:101:touch.500 00010000:00010000:3.0:1782727995.798220:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782727995.798242:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1666600/0x22171c6c29614f4b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20a75 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.798674:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1667e00/0x22171c6c29614f52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.798690:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1667e00/0x22171c6c29614f52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.798701:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1667e00/0x22171c6c29614f52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.798716:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1666800/0x22171c6c29614f59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.798722:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1666800/0x22171c6c29614f59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.798739:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1666800/0x22171c6c29614f59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782727995.799607:0:5806:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1782727995.799893:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c29614f60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.799905:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c29614f60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.799912:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c29614f60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.799947:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1667e00/0x22171c6c29614f52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.799953:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1667e00/0x22171c6c29614f52 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.799959:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1667e00/0x22171c6c29614f52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.799964:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56c1667e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1782727995.799968:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1667e00/0x22171c6c29614f52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.799975:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1667e00/0x22171c6c29614f52 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.799987:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d56d830bc00) 00010000:00010000:3.0:1782727995.799990:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727995.800000:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1667e00/0x22171c6c29614f52 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.800007:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1667e00/0x22171c6c29614f52 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782727995.800021:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007dee41db reply state 000000004df95895 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1666800/0x22171c6c29614f59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727995.800030:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782727995.800065:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1666600/0x22171c6c29614f4b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a75 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.800079:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c29614f60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a75 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.800087:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d56c4d03a00) 00010000:00010000:3.0:1782727995.800089:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782727995.800091:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f44f1c00, rc 0) 00000100:00100000:3.0:1782727995.800166:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ffb13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+10:10409:x1869325552072832:12345-192.168.202.31@tcp:101:touch.500 Request processed in 1974us (6326us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1782727995.800175:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 21 00010000:00010000:1.0:1782727995.803122:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1666800/0x22171c6c29614f59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.803141:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1666800/0x22171c6c29614f59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.803150:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1666800/0x22171c6c29614f59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.803157:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56c1666800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1782727995.803161:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1666800/0x22171c6c29614f59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.803169:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1666800/0x22171c6c29614f59 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.803195:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x7eaa65ec (ffff8d56c4d03d00) 00010000:00010000:1.0:1782727995.803199:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727995.803204:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1666800/0x22171c6c29614f59 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727995.803211:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1666800/0x22171c6c29614f59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727995.813048:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727995.813325:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552073088 00000100:00100000:3.0:1782727995.813337:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552073088 00000100:00100000:3.0:1782727995.813404:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 22 00000100:00100000:3.0:1782727995.813416:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ffb10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+9:10409:x1869325552073088:12345-192.168.202.31@tcp:36:touch.500 00010000:00010000:3.0:1782727995.813480:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782727995.813712:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c29614f60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a75 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.813755:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d56c4d03a00) 00010000:00010000:3.0:1782727995.813764:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782727995.813806:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0c00/0x22171c6c29614f6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.813818:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0c00/0x22171c6c29614f6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.813827:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0c00/0x22171c6c29614f6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782727995.813962:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008205d670 reply state 000000006d8a474e transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0c00/0x22171c6c29614f6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727995.813972:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782727995.814124:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ffb10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+10:10409:x1869325552073088:12345-192.168.202.31@tcp:36:touch.500 Request processed in 709us (1086us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1782727995.814132:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 22 00000100:00100000:0.0:1782727995.824752:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727995.825378:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552073216 00000100:00100000:2.0:1782727995.825388:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552073216 00000100:00100000:2.0:1782727995.825457:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23 00000100:00100000:2.0:1782727995.825469:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ffb10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+10:10409:x1869325552073216:12345-192.168.202.31@tcp:101:touch.500 00010000:00010000:2.0:1782727995.825538:0:7031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727995.825562:0:7031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c29614f75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20a7c expref: -99 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.825624:0:7031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c29614f75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a7c expref: 11 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.825639:0:7031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c29614f75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a7c expref: 11 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727995.825658:0:7031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d56c4d03900) 00010000:00010000:2.0:1782727995.825661:0:7031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782727995.825665:0:7031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3cfa00, rc 0) 00000100:00100000:2.0:1782727995.825720:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ffb10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+11:10409:x1869325552073216:12345-192.168.202.31@tcp:101:touch.500 Request processed in 254us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727995.825727:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23 00010000:00010000:3.0:1782727995.828658:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0c00/0x22171c6c29614f6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.828677:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0c00/0x22171c6c29614f6e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.828684:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0c00/0x22171c6c29614f6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.828690:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f44f0c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1782727995.828694:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0c00/0x22171c6c29614f6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.828719:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0c00/0x22171c6c29614f6e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.828736:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d56c4d03900) 00010000:00010000:3.0:1782727995.828739:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727995.828744:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0c00/0x22171c6c29614f6e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727995.828750:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0c00/0x22171c6c29614f6e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782727995.833981:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727995.834089:0:8323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552073344 00000100:00100000:2.0:1782727995.834099:0:8323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552073344 00000100:00100000:2.0:1782727995.834145:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 12 00000100:00100000:2.0:1782727995.834153:0:8323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff79f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1869325552073344:12345-192.168.202.31@tcp:8:touch.500 00010000:00080000:2.0:1782727995.834185:0:8323:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0000: connection from f9926b93-a1e5-4dad-ade1-7cd7c966fac6@192.168.202.31@tcp t0 exp 0000000000000000 cur 319 last 0 00000020:00000080:2.0:1782727995.834217:0:8323:0:(genops.c:1406:class_connect()) connect: client f9926b93-a1e5-4dad-ade1-7cd7c966fac6, cookie 0x22171c6c29614f7c 00002000:00100000:2.0:1782727995.834229:0:8323:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f9926b93-a1e5-4dad-ade1-7cd7c966fac6/ffff8d56f9367000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782727995.834378:0:8323:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782727995.834831:0:8323:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782727995.834869:0:8323:0:(import.c:65:import_set_state_nolock()) ffff8d56f9361000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782727995.835005:0:8323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff79f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2351:x1869325552073344:12345-192.168.202.31@tcp:8:touch.500 Request processed in 850us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727995.835014:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 12 00000100:00100000:1.0:1782727995.842730:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727995.845502:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552073472 00000100:00100000:3.0:1782727995.845531:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552073472 00000100:00100000:0.0:1782727995.848661:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 13 00000100:00100000:0.0:1782727995.848677:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:0:x1869325552073472:12345-192.168.202.31@tcp:2:touch.500 00000100:00080000:1.0:1782727995.853601:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727995.995491:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:0:x1869325552073472:12345-192.168.202.31@tcp:2:touch.500 Request processed in 146807us (152758us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1782727995.995504:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 13 00000001:00080000:2.0:1782727995.997618:0:6630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:2.0:1782727995.997640:0:6630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f9926b93-a1e5-4dad-ade1-7cd7c966fac6 00000100:00100000:0.0:1782727996.002601:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727996.002874:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552073728 00000100:00100000:3.0:1782727996.002885:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552073728 00000100:00100000:3.0:1782727996.002943:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2 00000100:00100000:3.0:1782727996.002953:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c743a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+10:10409:x1869325552073728:12345-192.168.202.31@tcp:35:touch.500 00000100:00100000:3.0:1782727996.003456:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c743a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+11:10409:x1869325552073728:12345-192.168.202.31@tcp:35:touch.500 Request processed in 502us (863us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1782727996.003465:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2 00000100:00100000:2.0:1782727996.013903:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869325572034432:0@lo:400:kworker.0 00000100:00100000:2.0:1782727996.013973:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727996.014028:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572034944:0@lo:400:kworker.0 00000100:00100000:2.0:1782727996.014057:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727996.014089:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782727996.014095:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869325572034560:0@lo:400:kworker.0 00000100:00100000:2.0:1782727996.014116:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782727996.014152:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572034432 00000100:00100000:2.0:1782727996.014159:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572034432 00000100:00100000:2.0:1782727996.014201:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572034560 00000100:00100000:2.0:1782727996.014205:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572034560 00000100:00100000:0.0:1782727996.014479:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572034688:0@lo:400:kworker.0 00000100:00100000:0.0:1782727996.014532:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727996.014569:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782727996.014575:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572034304:0@lo:400:kworker.0 00000100:00100000:0.0:1782727996.014603:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727996.014626:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869325572034816:0@lo:400:kworker.0 00000100:00100000:0.0:1782727996.014664:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782727996.014689:0:10280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572034816 00000100:00100000:0.0:1782727996.014692:0:10280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572034816 00000100:00100000:3.0:1782727996.018907:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1782727996.018934:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869325572034432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727996.019046:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869325572034432:12345-0@lo:400:kworker.0 Request processed in 126us (5072us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727996.019053:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1782727996.019088:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572034944 00000100:00100000:3.0:1782727996.019095:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572034944 00000100:00100000:0.0:1782727996.020627:0:10280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1782727996.020639:0:10280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869325572034816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727996.020716:0:10280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869325572034816:12345-0@lo:400:kworker.0 Request processed in 79us (6051us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727996.020723:0:10280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1782727996.020751:0:8323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572034688 00000100:00100000:0.0:1782727996.020757:0:8323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572034688 00000100:00100000:0.0:1782727996.020790:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782727996.020796:0:8323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c7438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572034688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727996.020829:0:8323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c7438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572034688:12345-0@lo:400:kworker.0 Request processed in 34us (6297us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727996.020835:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782727996.020852:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572034304 00000100:00100000:0.0:1782727996.020856:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572034304 00000100:00100000:0.0:1782727996.020877:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1782727996.020883:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0874850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3316:x1869325572034304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782727996.020914:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0874850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3316:x1869325572034304:12345-0@lo:400:kworker.0 Request processed in 31us (6310us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727996.020920:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1782727996.021056:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572034304:0@lo:400:kworker.0 00000100:00100000:0.0:1782727996.021072:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869325572034816:0@lo:400:kworker.0 00010000:00080000:0.0:1782727996.021086:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ff895500 x1869325572034688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782728012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727996.021117:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572034688:0@lo:400:kworker.0 00000100:00100000:3.0:1782727996.023447:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782727996.023464:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff895180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572034944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782727996.023580:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff895180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572034944:12345-0@lo:400:kworker.0 Request processed in 122us (9520us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727996.023588:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782727996.024450:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869325572034432:0@lo:400:kworker.0 00010000:00080000:1.0:1782727996.024471:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56ff897480 x1869325572034944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782728012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727996.024484:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572034944:0@lo:400:kworker.0 00000100:00100000:1.0:1782727996.024537:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782727996.024552:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572035072:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782727996.024652:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782727996.024660:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782727996.024665:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782727996.024809:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727996.024893:0:8059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572035072 00000100:00100000:3.0:1782727996.024899:0:8059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572035072 00000100:00100000:3.0:1782727996.024944:0:8059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782727996.024953:0:8059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572035072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782727996.024974:0:8059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782727996.025023:0:8059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572035072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727996.025031:0:8059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1782727996.025141:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f5ccce00 x1869325572035072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782728012 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782727996.025162:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ccce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572035072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782727996.026548:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1782727996.028407:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869325572034560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782727996.028544:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869325572034560:12345-0@lo:400:kworker.0 Request processed in 1986us (14426us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727996.028555:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782727996.028690:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869325572034560:0@lo:400:kworker.0 00000100:00100000:0.0:1782727996.032739:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727996.036358:0:10280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552073856 00000100:00100000:2.0:1782727996.036373:0:10280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552073856 00000100:00100000:2.0:1782727996.036495:0:10280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24 00000100:00100000:2.0:1782727996.036529:0:10280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+11:10410:x1869325552073856:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:2.0:1782727996.036556:0:10280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727996.036599:0:10280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29614f83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20a83 expref: -99 pid: 10280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.036675:0:10280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29614f8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.036690:0:10280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29614f8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.036702:0:10280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29614f8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727996.036769:0:10280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782727996.036772:0:10280:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782727996.036812:0:10280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29614f8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.036839:0:10280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29614f83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a83 expref: 13 pid: 10280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.036858:0:10280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29614f8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a83 expref: 12 pid: 10280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.036866:0:10280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d56d830bc00) 00010000:00010000:2.0:1782727996.036869:0:10280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782727996.036873:0:10280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3cf800, rc 0) 00000100:00100000:2.0:1782727996.036954:0:10280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+12:10410:x1869325552073856:12345-192.168.202.31@tcp:101:rm.0 Request processed in 450us (4226us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727996.036961:0:10280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24 00000100:00100000:1.0:1782727996.050915:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782727996.051029:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552074112 00000100:00100000:0.0:1782727996.051040:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552074112 00000100:00100000:0.0:1782727996.051106:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 25 00000100:00100000:0.0:1782727996.051117:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+12:10410:x1869325552074112:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:0.0:1782727996.051139:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727996.051159:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29614f91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20a8a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727996.051421:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1782727996.051649:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29614f91 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a8a expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.051666:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c4d03200) 00010000:00010000:0.0:1782727996.051669:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782727996.051674:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29614f91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a8a expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.051691:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56c0030e00, rc 0) 00000100:00100000:0.0:1782727996.051752:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+13:10410:x1869325552074112:12345-192.168.202.31@tcp:101:rm.0 Request processed in 636us (845us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1782727996.051760:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 25 00000100:00100000:1.0:1782727996.059965:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782727996.060061:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552074240 00000100:00100000:0.0:1782727996.060071:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552074240 00000100:00100000:0.0:1782727996.060162:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3 00000100:00100000:0.0:1782727996.060173:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+13:10410:x1869325552074240:12345-192.168.202.31@tcp:37:rm.0 00000100:00100000:2.0:1782727996.078453:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+13:10410:x1869325552074240:12345-192.168.202.31@tcp:37:rm.0 Request processed in 18273us (18489us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727996.078477:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3 00000100:00100000:1.0:1782727996.087724:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727996.087815:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552074496 00000100:00100000:3.0:1782727996.087825:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552074496 00000100:00100000:3.0:1782727996.087880:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4 00000100:00100000:3.0:1782727996.087890:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56e0583850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+13:10410:x1869325552074496:12345-192.168.202.31@tcp:35:rm.0 00000100:00100000:3.0:1782727996.088165:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56e0583850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+14:10410:x1869325552074496:12345-192.168.202.31@tcp:35:rm.0 Request processed in 274us (449us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1782727996.088173:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4 00000100:00100000:0.0:1782727996.109710:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727996.112470:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552074752 00000100:00100000:2.0:1782727996.112485:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552074752 00000100:00100000:2.0:1782727996.112660:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 26 00000100:00100000:2.0:1782727996.112673:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+14:10410:x1869325552074752:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:2.0:1782727996.112702:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782727996.112723:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29614f9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20a91 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.112848:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614fa6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.112862:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614fa6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.112875:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614fa6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782727996.112888:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1782727996.113082:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29614f9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a91 expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.113104:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614fa6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a91 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.113113:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d56d830bc00) 00010000:00010000:2.0:1782727996.113116:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782727996.113119:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3cf200, rc 0) 00000100:00100000:2.0:1782727996.113195:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+16:10410:x1869325552074752:12345-192.168.202.31@tcp:101:rm.0 Request processed in 524us (3493us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1782727996.113202:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 26 00000100:00100000:1.0:1782727996.117469:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727996.117622:0:10280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552074880 00000100:00100000:2.0:1782727996.117631:0:10280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552074880 00000100:00100000:2.0:1782727996.117776:0:10280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 27 00000100:00100000:2.0:1782727996.117786:0:10280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+16:10410:x1869325552074880:12345-192.168.202.31@tcp:41:rm.0 00000004:00000024:2.0:1782727996.117851:0:10280:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1782727996.117912:0:10280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+16:10410:x1869325552074880:12345-192.168.202.31@tcp:41:rm.0 Request processed in 128us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727996.117920:0:10280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 27 00000100:00100000:1.0:1782727996.124748:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782727996.127367:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552075008 00000100:00100000:0.0:1782727996.127383:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552075008 00000100:00100000:0.0:1782727996.127698:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 28 00000100:00100000:0.0:1782727996.127709:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+16:10410:x1869325552075008:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:0.0:1782727996.127732:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782727996.127754:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c29614fb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20a98 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.127820:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29614fbb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.127834:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29614fbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.127844:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29614fbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.127858:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614fc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.127865:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.127872:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.128008:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614fc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.128017:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.128024:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727996.128053:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1782727996.128056:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782727996.128074:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.128084:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.128093:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29614fbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.128100:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29614fbb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.128106:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29614fbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.128111:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56c0030e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1782727996.128115:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29614fbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.128123:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29614fbb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.128143:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d56d830bc00) 00010000:00010000:0.0:1782727996.128146:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727996.128151:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29614fbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.128157:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29614fbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.128171:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.128178:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614fc2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.128183:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614fc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.128188:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56c0031800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1782727996.128190:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614fc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.128196:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614fc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.128203:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x7eaa65ec (ffff8d56d830b200) 00010000:00010000:0.0:1782727996.128206:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727996.128208:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614fc2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.128214:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614fc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.128279:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c29614fb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a98 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.128293:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614fc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a98 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.128301:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d56c4d03900) 00010000:00010000:0.0:1782727996.128303:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782727996.128306:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56c0031400, rc 0) 00000100:00100000:0.0:1782727996.128441:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+17:10410:x1869325552075008:12345-192.168.202.31@tcp:101:rm.0 Request processed in 734us (3702us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727996.128449:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 28 00000100:00100000:0.0:1782727996.139671:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727996.139816:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552075264 00000100:00100000:2.0:1782727996.139825:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552075264 00000100:00100000:2.0:1782727996.139884:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 29 00000100:00100000:2.0:1782727996.139893:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+17:10410:x1869325552075264:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:2.0:1782727996.139955:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1782727996.139981:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031400/0x22171c6c29614fc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a98 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.140005:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c29614f75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a7c expref: 16 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.140016:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d56c4d03900) 00010000:00010000:2.0:1782727996.140032:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29614f8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a83 expref: 15 pid: 10280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.140040:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d56d830bc00) 00010000:00010000:2.0:1782727996.140058:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782727996.140079:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29614fd0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.140092:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29614fd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.140102:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29614fd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.140117:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29614fd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.140124:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29614fd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.140130:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29614fd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.140388:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c29614fde lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.140397:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c29614fde lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.140404:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c29614fde lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782727996.141378:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1782727996.141392:0:5807:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 320094881492ns, next at 321094879316ns, rc = 0 00010000:00010000:2.0:1782727996.141454:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614fe5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.141477:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.141487:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.141496:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614fe5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.141503:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614fe5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.141541:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614fe5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.141673:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782727996.141696:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c29614fde lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.141702:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c29614fde lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.141707:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c29614fde lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.141714:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3ce600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1782727996.141718:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c29614fde lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.141724:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c29614fde lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.141747:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d56c9dbb700) 00010000:00010000:2.0:1782727996.141750:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782727996.141754:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c29614fde lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.141759:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c29614fde lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.141777:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29614fd0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.141782:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29614fd0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.141787:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29614fd0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.141791:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3ce400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1782727996.141793:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29614fd0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.141799:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29614fd0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.141805:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d56d830bc00) 00010000:00010000:2.0:1782727996.141808:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782727996.141810:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29614fd0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782727996.141815:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29614fd0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782727996.141833:0:5807:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001fe7e28a reply state 000000005cfb600d transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29614fd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782727996.141842:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782727996.141930:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+16:10410:x1869325552075264:12345-192.168.202.31@tcp:36:rm.0 Request processed in 2033us (2266us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1782727996.141939:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 29 00010000:00010000:3.0:1782727996.145679:0:8304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782727996.145695:0:8304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614fe5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727996.145708:0:8304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3cee00 already unused, calling callback (ffffffffc152fcf0) 00010000:00010000:3.0:1782727996.145713:0:8304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614fe5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727996.145741:0:8304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614fe5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727996.145761:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d56c9dbb700) 00010000:00010000:3.0:1782727996.145764:0:8304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782727996.145768:0:8304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614fe5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727996.145774:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29614fe5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727996.145800:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727996.145802:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727996.145804:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727996.148500:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00010000:00010000:1.0:1782727996.157782:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29614fd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727996.157801:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29614fd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727996.157809:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29614fd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727996.157816:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3cf000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1782727996.157838:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29614fd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727996.157846:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29614fd7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727996.157864:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x7eaa65ec (ffff8d56c9dbb200) 00010000:00010000:1.0:1782727996.157867:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782727996.157872:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29614fd7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727996.157878:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29614fd7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x7eaa65ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782727996.158035:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552075520 00000100:00100000:3.0:1782727996.158043:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552075520 00000100:00100000:3.0:1782727996.158109:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5 00000100:00100000:3.0:1782727996.158119:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+15:10410:x1869325552075520:12345-192.168.202.31@tcp:35:rm.0 00000100:00100000:3.0:1782727996.158423:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f55e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+16:10410:x1869325552075520:12345-192.168.202.31@tcp:35:rm.0 Request processed in 304us (9934us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1782727996.158431:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5 00000100:00100000:1.0:1782727996.160701:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782727996.162773:0:10280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552075776 00000100:00100000:0.0:1782727996.162787:0:10280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552075776 00000100:00100000:0.0:1782727996.162907:0:10280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 30 00000100:00100000:0.0:1782727996.162917:0:10280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f95aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+16:10410:x1869325552075776:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:0.0:1782727996.162985:0:10280:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1782727996.163010:0:10280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29614fa6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a91 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.163032:0:10280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c29614f44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a6e expref: 15 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.163043:0:10280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d56d830bc00) 00010000:00010000:0.0:1782727996.163075:0:10280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c1667000/0x22171c6c29614f05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a60 expref: 14 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.163085:0:10280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c4d03200) 00010000:00010000:0.0:1782727996.163091:0:10280:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782727996.163116:0:10280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c29614fec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.163128:0:10280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c29614fec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.163137:0:10280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c29614fec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.163148:0:10280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614ff3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.163155:0:10280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614ff3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.163161:0:10280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614ff3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.163492:0:10280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29614ffa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.163501:0:10280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29614ffa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.163546:0:10280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29614ffa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782727996.164186:0:10280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1782727996.164209:0:10280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29614ffa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.164217:0:10280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29614ffa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.164223:0:10280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29614ffa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.164230:0:10280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56c0030e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1782727996.164234:0:10280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29614ffa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.164241:0:10280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29614ffa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.164252:0:10280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d56d830bf00) 00010000:00010000:0.0:1782727996.164255:0:10280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782727996.164259:0:10280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29614ffa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.164265:0:10280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29614ffa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.164302:0:10280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c29614fec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.164309:0:10280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c29614fec lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.164314:0:10280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c29614fec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.164319:0:10280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56c0030a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1782727996.164328:0:10280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c29614fec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.164335:0:10280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c29614fec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.164343:0:10280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d830b200) 00010000:00010000:0.0:1782727996.164345:0:10280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782727996.164348:0:10280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c29614fec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782727996.164354:0:10280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c29614fec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782727996.164367:0:10280:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006d97b47c reply state 0000000038d5c2cf transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614ff3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782727996.164378:0:10280:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782727996.164479:0:10280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f95aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+15:10410:x1869325552075776:12345-192.168.202.31@tcp:36:rm.0 Request processed in 1560us (3783us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1782727996.164489:0:10280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 30 00010000:00010000:3.0:1782727996.167320:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614ff3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727996.167342:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614ff3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727996.167351:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614ff3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727996.167380:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56c0031800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1782727996.167385:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614ff3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727996.167392:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614ff3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727996.167409:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d56d830b100) 00010000:00010000:3.0:1782727996.167411:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782727996.167416:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614ff3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782727996.167423:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29614ff3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782727996.397846:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782727996.527034:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d9f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572035200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782727996.527110:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782727996.527418:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572035200 00000100:00100000:3.0:1782727996.527426:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572035200 00000100:00100000:3.0:1782727996.527479:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782727996.527488:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572035200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782727996.527543:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782727996.527601:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f55e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572035200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1782727996.527608:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1782727996.527729:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56d9f5d180 x1869325572035200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782728012 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782727996.527749:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d9f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572035200:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782727997.426558:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782727997.662852:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782727997.662917:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782727997.663087:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552075904 00000100:00100000:0.0:1782727997.663098:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552075904 00000100:00100000:0.0:1782727997.663159:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 238 00000100:00100000:0.0:1782727997.663170:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+10:2352:x1869325552075904:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782727997.663293:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0877450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+10:2352:x1869325552075904:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 124us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1782727997.663301:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 238 00000100:00100000:2.0:1782727997.663540:0:8323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552076160 00000100:00100000:2.0:1782727997.663544:0:8323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552076160 00000100:00100000:2.0:1782727997.663600:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 40 00000100:00100000:2.0:1782727997.663607:0:8323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d9f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2352:x1869325552076160:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782727997.663640:0:8323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d9f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2352:x1869325552076160:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 34us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727997.663647:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 40 00000100:00080000:0.0:1782727997.664185:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782727997.670639:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782727997.678876:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552076032 00000100:00100000:2.0:1782727997.678890:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552076032 00000100:00100000:2.0:1782727997.678994:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 99 00000100:00100000:2.0:1782727997.679004:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+14:2352:x1869325552076032:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782727997.679094:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5c38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+14:2352:x1869325552076032:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 92us (9322us total) trans 0 rc 0/0 00000100:00100000:2.0:1782727997.679101:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 99 00000100:00080000:0.0:1782727997.679287:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782727998.446102:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782727999.469828:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782728000.493873:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782728001.134061:0:6700:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 325087548263ns, next at 326087545194ns, rc = 0 00000100:00100000:0.0:1782728001.134132:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782728001.134161:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f9ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572035328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782728001.134266:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782728001.135756:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572035328 00000100:00100000:1.0:1782728001.135768:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572035328 00000100:00100000:0.0:1782728001.135772:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5c39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572035456:0@lo:400:kworker.0 00000100:00100000:1.0:1782728001.135836:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782728001.135844:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782728001.135846:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572035328:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782728001.135879:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572035968:0@lo:400:kworker.0 00002000:00000024:1.0:1782728001.135887:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782728001.135906:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728001.135927:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782728001.135932:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869325572035584:0@lo:400:kworker.0 00000100:00100000:1.0:1782728001.135935:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5c3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572035328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728001.135943:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782728001.135956:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782728001.135987:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782728001.135987:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572035456 00000100:00100000:0.0:1782728001.135990:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572035456 00000100:00100000:1.0:1782728001.136000:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5c3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869325572035712:0@lo:400:kworker.0 00000100:00100000:1.0:1782728001.136026:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728001.136032:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1782728001.136039:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0874050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3314:x1869325572035456:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1782728001.136072:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f9ac3800 x1869325572035328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782728017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782728001.136073:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0874050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3314:x1869325572035456:12345-0@lo:400:kworker.0 Request processed in 35us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728001.136080:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1782728001.136097:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f9ac3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572035328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782728001.136107:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572035968 00000100:00100000:0.0:1782728001.136110:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572035968 00000100:00100000:1.0:1782728001.136115:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782728001.136120:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5c38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869325572035840:0@lo:400:kworker.0 00000100:00100000:0.0:1782728001.136140:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782728001.136142:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728001.136152:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572035968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782728001.136167:0:10280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572035584 00000100:00100000:1.0:1782728001.136170:0:10280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572035584 00000100:00100000:0.0:1782728001.136182:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572035968:12345-0@lo:400:kworker.0 Request processed in 31us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728001.136189:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782728001.136194:0:10280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572035712 00000100:00100000:1.0:1782728001.136196:0:10280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572035712 00000100:00100000:1.0:1782728001.136215:0:10280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572035840 00000100:00100000:1.0:1782728001.136217:0:10280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572035840 00000100:00100000:0.0:1782728001.136217:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5c39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572035456:0@lo:400:kworker.0 00010000:00080000:0.0:1782728001.136239:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56f5c3a680 x1869325572035968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782728017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782728001.136245:0:10280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1782728001.136250:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5c3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572035968:0@lo:400:kworker.0 00000100:00100000:1.0:1782728001.136251:0:10280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869325572035584:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782728001.136273:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782728001.136276:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782728001.136286:0:10280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5c3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869325572035584:12345-0@lo:400:kworker.0 Request processed in 35us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728001.136292:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782728001.136299:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869325572035712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782728001.136334:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869325572035712:12345-0@lo:400:kworker.0 Request processed in 36us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728001.138907:0:10280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1782728001.139517:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782728001.139566:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782728001.139602:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869325572035840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782728001.139742:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869325572035840:12345-0@lo:400:kworker.0 Request processed in 157us (3597us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728001.139750:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782728001.139830:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869325572035584:0@lo:400:kworker.0 00000100:00100000:0.0:1782728001.139885:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5c38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869325572035840:0@lo:400:kworker.0 00000100:00100000:0.0:1782728001.139901:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5c3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869325572035712:0@lo:400:kworker.0 00000001:00080000:3.0:1782728001.220989:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1782728001.221009:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:3.0:1782728001.221045:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1782728001.221295:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782728001.227466:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5c3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572036096:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782728001.227580:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782728001.228007:0:8323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572036096 00000100:00100000:2.0:1782728001.228016:0:8323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572036096 00000100:00100000:2.0:1782728001.228067:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782728001.228076:0:8323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9858850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572036096:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782728001.228116:0:8323:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1782728001.228149:0:8323:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a42453c, atime: 0x6a42453c, ctime: 0x6a42453c, blocks: 0x1 00010000:00010000:2.0:1782728001.228157:0:8323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000833fe0ea/0x22171c6c29615001 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728001.228172:0:8323:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=325s v=(0 0) 00010000:00010000:2.0:1782728001.228176:0:8323:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782728001.228181:0:8323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000833fe0ea/0x22171c6c29615001 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728001.228195:0:8323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000833fe0ea/0x22171c6c29615001 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728001.228204:0:8323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000833fe0ea/0x22171c6c29615001 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728001.228211:0:8323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000833fe0ea/0x22171c6c29615001 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728001.228244:0:8323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782728001.229106:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782728001.229117:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000833fe0ea/0x22171c6c29615001 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728001.229127:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3ce600 already unused, calling callback (ffffffffc152fcf0) 00010000:00010000:0.0:1782728001.229132:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000833fe0ea/0x22171c6c29615001 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728001.229141:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000833fe0ea/0x22171c6c29615001 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728001.229163:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000833fe0ea/0x22171c6c29615001 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728001.229169:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000833fe0ea/0x22171c6c29615001 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728001.229191:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782728001.229193:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782728001.229194:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782728001.229856:0:8323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9858850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1869325572036096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1777us (2273us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1782728001.229866:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1782728001.236632:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d56f5c3b480/2, rc 0, transno 4294967300 00000100:00100000:1.0:1782728001.236648:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5c3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572036096:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782728001.517679:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782728001.647758:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782728001.647781:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d9f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572036224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782728001.647852:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782728001.648034:0:8059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572036224 00000100:00100000:3.0:1782728001.648042:0:8059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572036224 00000100:00100000:3.0:1782728001.648093:0:8059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782728001.648102:0:8059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572036224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782728001.648139:0:8059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782728001.648195:0:8059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572036224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728001.648203:0:8059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1782728001.648324:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d56d9f5df80 x1869325572036224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782728017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782728001.648342:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d9f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572036224:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1782728002.436542:0:11707:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 63b: async write errors should be returned to fsync ============================================================= 06:13:21 (1782728001) 00010000:00010000:0.0:1782728002.544615:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782728002.786587:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728002.786686:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728002.786722:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782728002.786803:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552076416 00000100:00100000:2.0:1782728002.786812:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552076416 00000100:00100000:2.0:1782728002.786883:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 103 00000100:00100000:2.0:1782728002.786893:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d9f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2352:x1869325552076416:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782728002.786969:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d9f5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2352:x1869325552076416:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 77us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728002.786977:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 103 00000100:00080000:3.0:1782728002.787353:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782728002.789230:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552076288 00000100:00100000:0.0:1782728002.789242:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552076288 00000100:00100000:0.0:1782728002.789303:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 240 00000100:00100000:0.0:1782728002.789312:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0874450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+10:2353:x1869325552076288:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782728002.789389:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0874450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+10:2353:x1869325552076288:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 78us (2813us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728002.789409:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 240 00000100:00100000:0.0:1782728002.789444:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552076544 00000100:00100000:0.0:1782728002.789448:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552076544 00000100:00100000:0.0:1782728002.789482:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 42 00000100:00100000:0.0:1782728002.789488:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d9f5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2353:x1869325552076544:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782728002.789536:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d9f5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2353:x1869325552076544:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 48us (2812us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728002.789542:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 42 00000100:00080000:0.0:1782728002.789655:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782728003.480448:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728003.480823:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552076672 00000100:00100000:1.0:1782728003.480834:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552076672 00000100:00100000:1.0:1782728003.480889:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 31 00000100:00100000:1.0:1782728003.480900:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d9f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:10985:x1869325552076672:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1782728003.480918:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782728003.480953:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1e00/0x22171c6c29615008 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20a9f expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.481020:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c2961500f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.481033:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c2961500f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.481046:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c2961500f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782728003.481273:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782728003.481278:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782728003.481365:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c2961500f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.481389:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1e00/0x22171c6c29615008 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a9f expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.481407:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c2961500f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a9f expref: 6 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.481416:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d03b0700) 00010000:00010000:1.0:1782728003.481419:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782728003.481422:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f94b0600, rc 0) 00000100:00100000:1.0:1782728003.481483:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d9f5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:10985:x1869325552076672:12345-192.168.202.31@tcp:101:dd.0 Request processed in 585us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728003.481490:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 31 00000100:00100000:3.0:1782728003.491600:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782728003.491846:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552076928 00000100:00100000:2.0:1782728003.491856:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552076928 00000100:00100000:2.0:1782728003.491919:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 32 00000100:00100000:2.0:1782728003.491929:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d9f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:10985:x1869325552076928:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:2.0:1782728003.491947:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782728003.491950:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782728003.491975:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c2961500f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20a9f expref: 6 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.491991:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d03b0700) 00010000:00010000:2.0:1782728003.492001:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782728003.492016:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c29615016 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20aa6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.492345:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c2961501d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.492368:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c2961501d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.492377:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c2961501d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.492440:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29615024 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.492448:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29615024 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.492454:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29615024 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782728003.493316:0:5807:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1782728003.493621:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c2961502b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.493633:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c2961502b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.493642:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c2961502b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.493676:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c2961501d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.493684:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c2961501d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.493691:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c2961501d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.493705:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3cfa00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1782728003.493710:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c2961501d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.493718:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c2961501d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.493729:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c9dbb700) 00010000:00010000:2.0:1782728003.493732:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782728003.493736:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c2961501d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.493742:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c2961501d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782728003.493755:0:5807:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ed417bdd reply state 000000004f62c62f transno 4294967309 ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29615024 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782728003.493763:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782728003.493794:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c29615016 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20aa6 expref: 8 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.493811:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c2961502b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20aa6 expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.493817:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d56c9dbb800) 00010000:00010000:2.0:1782728003.493820:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782728003.493822:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3ce600, rc 0) 00000100:00100000:2.0:1782728003.493947:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d9f5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:10985:x1869325552076928:12345-192.168.202.31@tcp:101:dd.0 Request processed in 2018us (2354us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1782728003.493963:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 32 00010000:00010000:3.0:1782728003.498286:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29615024 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.498305:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29615024 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.498313:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29615024 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.498320:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3cf800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1782728003.498325:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29615024 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.498347:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29615024 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.498365:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff8d56c9dbb200) 00010000:00010000:3.0:1782728003.498368:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782728003.498374:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29615024 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.498381:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29615024 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782728003.500124:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728003.500343:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552077056 00000100:00100000:3.0:1782728003.500358:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552077056 00000100:00100000:3.0:1782728003.500427:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 15 00000100:00100000:3.0:1782728003.500442:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5c38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1869325552077056:12345-192.168.202.31@tcp:8:dd.0 00010000:00080000:3.0:1782728003.500490:0:6606:0:(ldlm_lib.c:1434:target_handle_connect()) lustre-OST0001: connection from f9926b93-a1e5-4dad-ade1-7cd7c966fac6@192.168.202.31@tcp t0 exp 0000000000000000 cur 327 last 0 00000020:00000080:3.0:1782728003.500570:0:6606:0:(genops.c:1406:class_connect()) connect: client f9926b93-a1e5-4dad-ade1-7cd7c966fac6, cookie 0x22171c6c29615039 00002000:00100000:3.0:1782728003.500587:0:6606:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f9926b93-a1e5-4dad-ade1-7cd7c966fac6/ffff8d56c756b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782728003.500620:0:6606:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782728003.501063:0:6606:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782728003.501106:0:6606:0:(import.c:65:import_set_state_nolock()) ffff8d56c756a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782728003.501412:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5c38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2351:x1869325552077056:12345-192.168.202.31@tcp:8:dd.0 Request processed in 970us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728003.501482:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 15 00000100:00100000:1.0:1782728003.506545:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728003.507631:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552077184 00000100:00100000:1.0:1782728003.507642:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552077184 00000100:00080000:3.0:1782728003.507710:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782728003.507851:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 16 00000100:00100000:1.0:1782728003.507866:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:10985:x1869325552077184:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1782728003.507894:0:6607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782728003.507917:0:6607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086bc6922/0x22171c6c29615040 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20aad expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782728003.507941:0:6607:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782728003.507960:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=327s v=(0 0) 00010000:00010000:1.0:1782728003.507965:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782728003.507974:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086bc6922/0x22171c6c29615040 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20aad expref: 7 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.507994:0:6607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000086bc6922/0x22171c6c29615040 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20aad expref: 7 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.508007:0:6607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f94b1e00, rc 0) 00000100:00100000:1.0:1782728003.508077:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:10985:x1869325552077184:12345-192.168.202.31@tcp:101:dd.0 Request processed in 216us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728003.508087:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 16 00000100:00100000:3.0:1782728003.524875:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782728003.525230:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552077440 00000100:00100000:2.0:1782728003.525245:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552077440 00000100:00100000:2.0:1782728003.525324:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 6 00000100:00100000:2.0:1782728003.525336:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d9f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:10985:x1869325552077440:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:2.0:1782728003.525756:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d9f5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:10985:x1869325552077440:12345-192.168.202.31@tcp:35:dd.0 Request processed in 420us (895us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1782728003.525766:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 6 00000100:00100000:2.0:1782728003.542926:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728003.543036:0:10280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552077568 00000100:00100000:3.0:1782728003.543060:0:10280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552077568 00000100:00100000:3.0:1782728003.543137:0:10280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 33 00000100:00100000:3.0:1782728003.543151:0:10280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:10986:x1869325552077568:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:3.0:1782728003.543200:0:10280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782728003.543240:0:10280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0c00/0x22171c6c29615047 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20ab4 expref: -99 pid: 10280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.543322:0:10280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c2961504e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.543339:0:10280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c2961504e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.543353:0:10280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c2961504e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782728003.543577:0:10280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782728003.543582:0:10280:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1782728003.543621:0:10280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c2961504e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.543653:0:10280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0c00/0x22171c6c29615047 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20ab4 expref: 10 pid: 10280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.543743:0:10280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c2961504e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20ab4 expref: 9 pid: 10280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.543756:0:10280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c4d03a00) 00010000:00010000:3.0:1782728003.543759:0:10280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782728003.543763:0:10280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f44f1c00, rc 0) 00000100:00100000:3.0:1782728003.543858:0:10280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+9:10986:x1869325552077568:12345-192.168.202.31@tcp:101:rm.0 Request processed in 710us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728003.543866:0:10280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 33 00000100:00100000:1.0:1782728003.563942:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728003.564177:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552077824 00000100:00100000:3.0:1782728003.564317:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552077824 00000100:00100000:3.0:1782728003.564408:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 34 00000100:00100000:3.0:1782728003.564488:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+9:10986:x1869325552077824:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:3.0:1782728003.564659:0:7031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782728003.564763:0:7031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c2961502b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20aa6 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.564791:0:7031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d56c9dbb800) 00010000:00010000:3.0:1782728003.564811:0:7031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c2961504e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20ab4 expref: 8 pid: 10280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.564822:0:7031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c4d03a00) 00010000:00010000:3.0:1782728003.564830:0:7031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782728003.564861:0:7031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0c00/0x22171c6c29615055 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.564877:0:7031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0c00/0x22171c6c29615055 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.564889:0:7031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0c00/0x22171c6c29615055 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.564909:0:7031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0400/0x22171c6c2961505c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.564916:0:7031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0400/0x22171c6c2961505c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.564938:0:7031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0400/0x22171c6c2961505c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.565406:0:7031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1200/0x22171c6c29615063 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.565480:0:7031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1200/0x22171c6c29615063 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.565491:0:7031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1200/0x22171c6c29615063 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.565688:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782728003.567847:0:7031:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1782728003.567867:0:7031:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 327521356981ns, next at 328521353416ns, rc = 0 00010000:00010000:2.0:1782728003.567950:0:7031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c2961506a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.567967:0:7031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c2961506a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.567978:0:7031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c2961506a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.567987:0:7031:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c2961506a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.567994:0:7031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c2961506a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.568000:0:7031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c2961506a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.568034:0:7031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782728003.568057:0:7031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1200/0x22171c6c29615063 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.568064:0:7031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1200/0x22171c6c29615063 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.568072:0:7031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1200/0x22171c6c29615063 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.568074:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782728003.568092:0:7031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f44f1200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1782728003.568093:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c2961506a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.568102:0:7031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1200/0x22171c6c29615063 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.568109:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3ce400 already unused, calling callback (ffffffffc152fcf0) 00010000:00010000:2.0:1782728003.568115:0:7031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1200/0x22171c6c29615063 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.568130:0:7031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d56c4d03400) 00010000:00010000:1.0:1782728003.568130:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c2961506a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.568144:0:7031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782728003.568167:0:7031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1200/0x22171c6c29615063 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.568176:0:7031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1200/0x22171c6c29615063 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.568194:0:7031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0c00/0x22171c6c29615055 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.568200:0:7031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0c00/0x22171c6c29615055 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.568213:0:7031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0c00/0x22171c6c29615055 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.568227:0:7031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f44f0c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1782728003.568231:0:7031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0c00/0x22171c6c29615055 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.568237:0:7031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0c00/0x22171c6c29615055 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.568245:0:7031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c4d03b00) 00010000:00010000:2.0:1782728003.568248:0:7031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782728003.568251:0:7031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0c00/0x22171c6c29615055 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.568257:0:7031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0c00/0x22171c6c29615055 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.568266:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c2961506a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782728003.568277:0:7031:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005e1fcd85 reply state 00000000f77463bc transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0400/0x22171c6c2961505c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.568288:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d56c4d03400) 00000100:00100000:2.0:1782728003.568289:0:7031:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782728003.568297:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782728003.568303:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c2961506a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.568311:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c2961506a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.568339:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782728003.568343:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782728003.568345:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782728003.568395:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+9:10986:x1869325552077824:12345-192.168.202.31@tcp:36:rm.0 Request processed in 3972us (4462us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1782728003.568405:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 34 00010000:00010000:3.0:1782728003.574107:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0400/0x22171c6c2961505c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.574132:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0400/0x22171c6c2961505c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.574140:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0400/0x22171c6c2961505c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.574147:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f44f0400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1782728003.574153:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0400/0x22171c6c2961505c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.574162:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0400/0x22171c6c2961505c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.574264:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff8d56c4d03300) 00010000:00010000:3.0:1782728003.574268:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782728003.574274:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0400/0x22171c6c2961505c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.574297:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0400/0x22171c6c2961505c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782728003.699781:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782728003.699973:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552077952 00000100:00100000:2.0:1782728003.699987:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552077952 00000100:00100000:2.0:1782728003.700060:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 35 00000100:00100000:2.0:1782728003.700072:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:10989:x1869325552077952:12345-192.168.202.31@tcp:101:multiop.0 00010000:00010000:2.0:1782728003.700103:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782728003.700134:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29615071 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20abb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.700370:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29615078 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.700389:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29615078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.700403:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29615078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782728003.700489:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782728003.700494:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782728003.700829:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29615078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.700864:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29615071 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20abb expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.700886:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29615078 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20abb expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.700897:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c9dbb700) 00010000:00010000:2.0:1782728003.700900:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782728003.700904:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3cf200, rc 0) 00000100:00100000:2.0:1782728003.700983:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+9:10989:x1869325552077952:12345-192.168.202.31@tcp:101:multiop.0 Request processed in 913us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728003.700993:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 35 00000100:00100000:2.0:1782728003.706879:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728003.707134:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552078208 00000100:00100000:1.0:1782728003.707147:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552078208 00000100:00100000:1.0:1782728003.707389:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 36 00000100:00100000:1.0:1782728003.707402:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+9:10989:x1869325552078208:12345-192.168.202.31@tcp:101:multiop.0 00010000:00010000:1.0:1782728003.707430:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782728003.707435:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782728003.707473:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29615078 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20abb expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.707499:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c9dbb700) 00010000:00010000:1.0:1782728003.707563:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782728003.707583:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1800/0x22171c6c2961507f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20ac2 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.707783:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0800/0x22171c6c29615086 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.707800:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0800/0x22171c6c29615086 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.707812:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0800/0x22171c6c29615086 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.707829:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c2961508d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.707837:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c2961508d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.707844:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c2961508d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782728003.708652:0:5806:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1782728003.708871:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0c00/0x22171c6c29615094 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.708885:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0c00/0x22171c6c29615094 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.708896:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0c00/0x22171c6c29615094 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.708936:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0800/0x22171c6c29615086 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.708955:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0800/0x22171c6c29615086 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.708963:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0800/0x22171c6c29615086 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.708970:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f94b0800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1782728003.708975:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0800/0x22171c6c29615086 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.708983:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0800/0x22171c6c29615086 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.708995:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d03b0c00) 00010000:00010000:1.0:1782728003.708999:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782728003.709004:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0800/0x22171c6c29615086 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.709010:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0800/0x22171c6c29615086 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782728003.709024:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002e938fbc reply state 0000000056b8372d transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c2961508d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782728003.709034:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782728003.709070:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1800/0x22171c6c2961507f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20ac2 expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.709091:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0c00/0x22171c6c29615094 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20ac2 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.709111:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d56d03b0400) 00010000:00010000:1.0:1782728003.709114:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782728003.709117:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f94b0c00, rc 0) 00000100:00100000:1.0:1782728003.709984:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+11:10989:x1869325552078208:12345-192.168.202.31@tcp:101:multiop.0 Request processed in 2578us (3112us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1782728003.709998:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 36 00010000:00010000:1.0:1782728003.716065:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c2961508d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.716088:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c2961508d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.716097:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c2961508d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.716104:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f94b0200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1782728003.716110:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c2961508d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.716119:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c2961508d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.716140:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd143313f (ffff8d56d03b0300) 00010000:00010000:1.0:1782728003.716143:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782728003.716148:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c2961508d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728003.716167:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c2961508d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd143313f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782728003.720820:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728003.721417:0:8323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552078336 00000100:00100000:0.0:1782728003.721430:0:8323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552078336 00000100:00100000:0.0:1782728003.721556:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 17 00000100:00100000:0.0:1782728003.721568:0:8323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff895880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:10989:x1869325552078336:12345-192.168.202.31@tcp:101:multiop.0 00010000:00010000:0.0:1782728003.721595:0:8323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782728003.721627:0:8323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d61af9b1/0x22171c6c296150a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20ac9 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782728003.721662:0:8323:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782728003.721838:0:8323:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=327s v=(0 0) 00010000:00010000:0.0:1782728003.721844:0:8323:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782728003.721856:0:8323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d61af9b1/0x22171c6c296150a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20ac9 expref: 6 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728003.721876:0:8323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d61af9b1/0x22171c6c296150a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20ac9 expref: 6 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728003.721909:0:8323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56c0031400, rc 0) 00000100:00100000:0.0:1782728003.721994:0:8323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff895880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:10989:x1869325552078336:12345-192.168.202.31@tcp:101:multiop.0 Request processed in 428us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728003.722003:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 17 00000100:00100000:3.0:1782728003.740012:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782728003.740186:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552078464 00000100:00100000:2.0:1782728003.740198:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552078464 00000100:00100000:2.0:1782728003.740276:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 37 00000100:00100000:2.0:1782728003.740286:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d9f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+10:10989:x1869325552078464:12345-192.168.202.31@tcp:44:multiop.0 00000001:00080000:1.0:1782728003.776551:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967312 is committed 00000004:00080000:1.0:1782728003.776587:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1782728003.777009:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782728003.777038:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d9f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572036352:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782728003.777130:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782728003.777348:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572036352 00000100:00100000:3.0:1782728003.777359:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572036352 00000100:00100000:3.0:1782728003.777434:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782728003.777444:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d9f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572036352:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782728003.777485:0:6604:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00000100:00080000:1.0:1782728003.777581:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782728003.777703:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049d23ef3/0x22171c6c296150a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.777732:0:6604:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000086bc6922/0x22171c6c29615040 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20aad expref: 6 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.777743:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782728003.777748:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782728003.777753:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049d23ef3/0x22171c6c296150a9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.777790:0:6604:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000086bc6922/0x22171c6c29615040 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20aad expref: 6 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.777808:0:6604:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000086bc6922/0x22171c6c29615040 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20aad expref: 6 pid: 6607 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782728003.777842:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d9f5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6604:1869325572036480:192.168.202.31@tcp:104: 00000100:00100000:3.0:1782728003.778098:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f44b6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782728003.778295:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d9f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:10989:x1869325552078464:12345-192.168.202.31@tcp:44:multiop.0 Request processed in 38007us (38294us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728003.778308:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 37 00000100:00100000:1.0:1782728003.785651:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728003.785813:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552078592 00000100:00100000:0.0:1782728003.785825:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552078592 00010000:00010000:0.0:1782728003.785885:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000086bc6922/0x22171c6c29615040 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20aad expref: 7 pid: 6607 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782728003.785937:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 29 00000100:00100000:0.0:1782728003.785948:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:2352:x1869325552078592:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782728003.785966:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782728003.785973:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000086bc6922/0x22171c6c29615040 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20aad expref: 7 pid: 6607 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728003.785990:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000086bc6922/0x22171c6c29615040 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20aad expref: 7 pid: 6607 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728003.786026:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782728003.786031:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782728003.786038:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049d23ef3/0x22171c6c296150a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728003.786050:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049d23ef3/0x22171c6c296150a9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728003.786095:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782728003.786370:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:2352:x1869325552078592:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 422us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728003.786379:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 29 00010000:00010000:3.0:1782728003.788010:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086bc6922/0x22171c6c29615040 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20aad expref: 6 pid: 6607 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782728003.788038:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d9f5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6604:1869325572036480:192.168.202.31@tcp:104: 00010000:00010000:3.0:1782728003.788075:0:6604:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000049d23ef3/0x22171c6c296150a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.788088:0:6604:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000049d23ef3/0x22171c6c296150a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.788098:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049d23ef3/0x22171c6c296150a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.788111:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049d23ef3/0x22171c6c296150a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.788121:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049d23ef3/0x22171c6c296150a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728003.788225:0:6604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782728003.788694:0:8303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782728003.788703:0:8303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049d23ef3/0x22171c6c296150a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.788713:0:8303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f44f0400 already unused, calling callback (ffffffffc152fcf0) 00010000:00010000:2.0:1782728003.788718:0:8303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049d23ef3/0x22171c6c296150a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.788729:0:8303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049d23ef3/0x22171c6c296150a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.788754:0:8303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049d23ef3/0x22171c6c296150a9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.788761:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049d23ef3/0x22171c6c296150a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728003.788791:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782728003.788793:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782728003.788795:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782728003.789316:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d9f5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1869325572036352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11870us (12183us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1782728003.789338:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1782728003.789544:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d56d9f5f480/2, rc 0, transno 4294967299 00000100:00100000:2.0:1782728003.789552:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d9f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572036352:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782728003.789761:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782728003.789923:0:8323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552078720 00000100:00100000:2.0:1782728003.789932:0:8323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552078720 00000100:00100000:2.0:1782728003.790016:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 19 00000100:00100000:2.0:1782728003.790028:0:8323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2353:x1869325552078720:12345-192.168.202.31@tcp:16:multiop.0 00000100:00100000:2.0:1782728003.790167:0:8323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9ac0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2353:x1869325552078720:12345-192.168.202.31@tcp:16:multiop.0 Request processed in 141us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728003.790175:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 19 00000100:00100000:0.0:1782728003.794414:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728003.794577:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552078976 00000100:00100000:3.0:1782728003.794589:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552078976 00000100:00100000:3.0:1782728003.794702:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 7 00000100:00100000:3.0:1782728003.794714:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:10989:x1869325552078976:12345-192.168.202.31@tcp:35:multiop.0 00000100:00100000:3.0:1782728003.795384:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5c38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:10989:x1869325552078976:12345-192.168.202.31@tcp:35:multiop.0 Request processed in 668us (982us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1782728003.795394:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 7 00010000:00010000:0.0:1782728004.589773:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782728005.324280:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:1.0:1782728005.324307:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f9926b93-a1e5-4dad-ade1-7cd7c966fac6 00010000:00010000:1.0:1782728005.614868:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782728006.255224:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f9ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572036608:0@lo:400:kworker.0 00000100:00100000:3.0:1782728006.255227:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f9ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869325572036736:0@lo:400:kworker.0 00000100:00100000:2.0:1782728006.255340:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f9ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869325572036864:0@lo:400:kworker.0 00000100:00100000:1.0:1782728006.256282:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f9ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572036992:0@lo:400:kworker.0 00000100:00100000:3.0:1782728006.260652:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782728006.260746:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f9ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572037248:0@lo:400:kworker.0 00000100:00100000:3.0:1782728006.260792:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782728006.260880:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572036736 00000100:00100000:3.0:1782728006.260890:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572036736 00000100:00100000:3.0:1782728006.260984:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782728006.260996:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d9f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869325572036736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782728006.261076:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d9f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869325572036736:12345-0@lo:400:kworker.0 Request processed in 81us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728006.261084:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782728006.261114:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572037248 00000100:00100000:3.0:1782728006.261118:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572037248 00000100:00100000:3.0:1782728006.261156:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1782728006.261163:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d9f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572037248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782728006.261206:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d9f5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572037248:12345-0@lo:400:kworker.0 Request processed in 44us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728006.261233:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1782728006.261251:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782728006.261293:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f9ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869325572036736:0@lo:400:kworker.0 00000100:00100000:3.0:1782728006.261305:0:3315:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000004:00080000:3.0:1782728006.261311:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d56d9f5f480, transno 4294967299 00000100:00100000:3.0:1782728006.261322:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f9ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572037248:0@lo:400:kworker.0 00000100:00100000:0.0:1782728006.263195:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728006.263265:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f9ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869325572037120:0@lo:400:kworker.0 00000100:00100000:3.0:1782728006.263303:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572036608 00000100:00100000:3.0:1782728006.263310:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572036608 00000100:00100000:0.0:1782728006.263328:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782728006.263355:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1782728006.263363:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3314:x1869325572036608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782728006.263397:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572037120 00000100:00100000:0.0:1782728006.263403:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572037120 00000100:00100000:3.0:1782728006.263419:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0877850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3314:x1869325572036608:12345-0@lo:400:kworker.0 Request processed in 56us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728006.263425:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1782728006.263458:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782728006.263469:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869325572037120:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782728006.263471:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782728006.263662:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5c3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869325572037120:12345-0@lo:400:kworker.0 Request processed in 195us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728006.263670:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782728006.263709:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f9ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572036608:0@lo:400:kworker.0 00000100:00100000:0.0:1782728006.263723:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f9ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869325572037120:0@lo:400:kworker.0 00000100:00100000:2.0:1782728006.266810:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782728006.266863:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572037376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782728006.266911:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782728006.266945:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572037376 00000100:00100000:2.0:1782728006.266954:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572037376 00000100:00100000:2.0:1782728006.267043:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782728006.267053:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1869325572037376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782728006.267095:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782728006.267140:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1869325572037376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728006.267149:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1782728006.267177:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782728006.267235:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572037376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782728006.267756:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572036864 00000100:00100000:0.0:1782728006.267761:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572036864 00000100:00100000:0.0:1782728006.267801:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1782728006.267807:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869325572036864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782728006.267860:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869325572036864:12345-0@lo:400:kworker.0 Request processed in 54us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728006.267892:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1782728006.268392:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782728006.268702:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f9ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869325572036864:0@lo:400:kworker.0 00000100:00100000:1.0:1782728006.271428:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782728006.271502:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572036992 00000100:00100000:1.0:1782728006.271538:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572036992 00000100:00100000:1.0:1782728006.271614:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782728006.271626:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9ac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1869325572036992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782728006.271693:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9ac2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1869325572036992:12345-0@lo:400:kworker.0 Request processed in 69us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728006.271700:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782728006.271761:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f9ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572036992:0@lo:400:kworker.0 00000001:00080000:3.0:1782728006.320467:0:6630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:1.0:1782728006.640337:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782728006.766192:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782728006.766230:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d9f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572037504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782728006.766323:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782728006.766938:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572037504 00000100:00100000:3.0:1782728006.766949:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572037504 00000100:00100000:3.0:1782728006.767019:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782728006.767031:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572037504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782728006.767078:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782728006.767222:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572037504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 193us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728006.767232:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782728006.768071:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d9f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572037504:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782728007.661793:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782728007.905680:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728007.905728:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728007.905762:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728007.905798:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728007.905805:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552079232 00000100:00100000:3.0:1782728007.905816:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552079232 00000100:00100000:2.0:1782728007.905856:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552079104 00000100:00100000:2.0:1782728007.905860:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552079104 00000100:00100000:2.0:1782728007.905950:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 242 00000100:00100000:2.0:1782728007.905962:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0875850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2354:x1869325552079104:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782728007.906056:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0875850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2354:x1869325552079104:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 96us (390us total) trans 0 rc 0/0 00000100:00080000:1.0:1782728007.906060:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782728007.906064:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 242 00000100:00100000:3.0:1782728007.906120:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 107 00000100:00100000:3.0:1782728007.906128:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:2354:x1869325552079232:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782728007.906166:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:2354:x1869325552079232:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 39us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728007.906185:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 107 00000100:00100000:3.0:1782728007.906206:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552079360 00000100:00100000:3.0:1782728007.906209:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552079360 00000100:00100000:3.0:1782728007.906240:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552079488 00000100:00100000:3.0:1782728007.906243:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552079488 00000100:00100000:3.0:1782728007.906274:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 45 00000100:00100000:0.0:1782728007.906280:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 46 00000100:00100000:3.0:1782728007.906281:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2354:x1869325552079360:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782728007.906289:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2354:x1869325552079488:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782728007.906315:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2354:x1869325552079360:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 34us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728007.906315:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2354:x1869325552079488:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 27us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728007.906321:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 46 00000100:00100000:3.0:1782728007.906324:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 45 00000100:00080000:3.0:1782728007.906340:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782728007.906343:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782728008.504266:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728008.505738:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552079616 00000100:00100000:0.0:1782728008.505748:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552079616 00000100:00100000:0.0:1782728008.505807:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 38 00000100:00100000:0.0:1782728008.505815:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:11228:x1869325552079616:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1782728008.505832:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782728008.505850:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c296150b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20ad0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728008.505903:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c296150b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728008.505913:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c296150b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728008.505922:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c296150b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782728008.506224:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782728008.506229:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1782728008.506315:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c296150b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728008.506343:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c296150b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20ad0 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728008.506357:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c296150b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20ad0 expref: 8 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728008.506363:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d830bf00) 00010000:00010000:0.0:1782728008.506365:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782728008.506368:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56c0030e00, rc 0) 00000100:00100000:0.0:1782728008.506425:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:11228:x1869325552079616:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 610us (2169us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728008.506431:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 38 00000100:00100000:0.0:1782728008.513829:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728008.514287:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552079744 00000100:00100000:3.0:1782728008.514297:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552079744 00000100:00100000:3.0:1782728008.514369:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 39 00000100:00100000:3.0:1782728008.514379:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5c39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:11228:x1869325552079744:12345-192.168.202.31@tcp:41:lfs.0 00000004:00000024:3.0:1782728008.514423:0:5807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1782728008.514497:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5c39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:11228:x1869325552079744:12345-192.168.202.31@tcp:41:lfs.0 Request processed in 120us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728008.514505:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 39 00000100:00100000:1.0:1782728008.523437:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782728008.523677:0:8059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552079872 00000100:00100000:2.0:1782728008.523686:0:8059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552079872 00000100:00100000:2.0:1782728008.523774:0:8059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 54 00000100:00100000:2.0:1782728008.523784:0:8059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9ac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:11228:x1869325552079872:12345-192.168.202.31@tcp:13:lfs.0 00002000:00000024:2.0:1782728008.523825:0:8059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782728008.523922:0:8059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9ac3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:11228:x1869325552079872:12345-192.168.202.31@tcp:13:lfs.0 Request processed in 140us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728008.523928:0:8059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 54 00000100:00100000:1.0:1782728008.528589:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728008.528709:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552080000 00000100:00100000:3.0:1782728008.528717:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552080000 00000100:00100000:3.0:1782728008.528807:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 55 00000100:00100000:3.0:1782728008.528828:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:11228:x1869325552080000:12345-192.168.202.31@tcp:13:lfs.0 00002000:00000024:3.0:1782728008.528869:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782728008.528963:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:11228:x1869325552080000:12345-192.168.202.31@tcp:13:lfs.0 Request processed in 137us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728008.528971:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 55 00010000:00010000:0.0:1782728008.685962:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782728008.865654:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967313 is committed 00010000:00010000:1.0:1782728009.709681:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782728010.747274:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782728011.374766:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869325572037888:0@lo:400:kworker.0 00000100:00100000:2.0:1782728011.374835:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782728011.374888:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782728011.374895:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572038016:0@lo:400:kworker.0 00000100:00100000:2.0:1782728011.374921:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782728011.374958:0:10280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572037888 00000100:00100000:2.0:1782728011.374966:0:10280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572037888 00000100:00100000:2.0:1782728011.375018:0:10280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1782728011.375028:0:10280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869325572037888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782728011.375085:0:10280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869325572037888:12345-0@lo:400:kworker.0 Request processed in 59us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728011.375093:0:10280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1782728011.375115:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572038016 00000100:00100000:2.0:1782728011.375119:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572038016 00000100:00100000:2.0:1782728011.375154:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782728011.375161:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572038016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782728011.375189:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572038016:12345-0@lo:400:kworker.0 Request processed in 29us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728011.375196:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1782728011.375212:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782728011.375216:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782728011.375239:0:3316:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1782728011.375245:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d56f5c3b480, transno 4294967300 00000100:00100000:2.0:1782728011.375255:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572038016:0@lo:400:kworker.0 00000100:00100000:2.0:1782728011.375266:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869325572037888:0@lo:400:kworker.0 00000100:00100000:0.0:1782728011.375428:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572037632:0@lo:400:kworker.0 00000100:00100000:0.0:1782728011.375461:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728011.375485:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869325572038144:0@lo:400:kworker.0 00000100:00100000:0.0:1782728011.375505:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728011.375553:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782728011.375559:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869325572037760:0@lo:400:kworker.0 00000100:00100000:0.0:1782728011.375581:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728011.375597:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572038272:0@lo:400:kworker.0 00000100:00100000:0.0:1782728011.375616:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728011.375648:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572038144 00000100:00100000:0.0:1782728011.375653:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572038144 00000100:00100000:0.0:1782728011.375680:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572037760 00000100:00100000:0.0:1782728011.375683:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572037760 00000100:00100000:0.0:1782728011.375711:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782728011.375717:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869325572038144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782728011.375749:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5c3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869325572038144:12345-0@lo:400:kworker.0 Request processed in 32us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728011.375754:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782728011.375766:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782728011.375772:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5c39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869325572037760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782728011.375794:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5c39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869325572037760:12345-0@lo:400:kworker.0 Request processed in 23us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728011.375799:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782728011.375814:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572038272 00000100:00100000:0.0:1782728011.375816:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572038272 00000100:00100000:0.0:1782728011.375835:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782728011.375842:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5c3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572038272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782728011.375869:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5c3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572038272:12345-0@lo:400:kworker.0 Request processed in 28us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728011.375874:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782728011.376204:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572037632 00000100:00100000:0.0:1782728011.376208:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572037632 00000100:00100000:0.0:1782728011.376232:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1782728011.376238:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0875450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3314:x1869325572037632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782728011.376269:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0875450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3314:x1869325572037632:12345-0@lo:400:kworker.0 Request processed in 30us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728011.376284:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1782728011.376321:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782728011.376331:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572038400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782728011.376354:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728011.376387:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869325572037760:0@lo:400:kworker.0 00000100:00100000:0.0:1782728011.376397:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572038272:0@lo:400:kworker.0 00000100:00100000:0.0:1782728011.376404:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572037632:0@lo:400:kworker.0 00000100:00100000:0.0:1782728011.376412:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869325572038144:0@lo:400:kworker.0 00000100:00100000:2.0:1782728011.376731:0:8059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572038400 00000100:00100000:2.0:1782728011.376735:0:8059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572038400 00000100:00100000:2.0:1782728011.376768:0:8059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782728011.376775:0:8059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572038400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782728011.376799:0:8059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782728011.376834:0:8059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5c3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572038400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728011.376840:0:8059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1782728011.376856:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782728011.376860:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782728011.377074:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5c38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572038400:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782728011.757669:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782728011.888065:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d9f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572038528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782728011.888158:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782728011.888368:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572038528 00000100:00100000:1.0:1782728011.888378:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572038528 00000100:00100000:1.0:1782728011.888443:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782728011.888453:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572038528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782728011.888492:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782728011.893521:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5c38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572038528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5046us (5339us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728011.893537:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782728011.899638:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d9f5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572038528:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782728012.784357:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782728013.028814:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728013.028859:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728013.028889:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728013.028912:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728013.028938:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552080256 00000100:00100000:0.0:1782728013.028946:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552080256 00000100:00100000:0.0:1782728013.029009:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 111 00000100:00100000:0.0:1782728013.029019:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:2352:x1869325552080256:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782728013.029090:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:2352:x1869325552080256:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 72us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728013.029105:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 111 00000100:00100000:0.0:1782728013.029138:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552080384 00000100:00100000:0.0:1782728013.029142:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552080384 00000100:00100000:0.0:1782728013.029167:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552080512 00000100:00100000:0.0:1782728013.029170:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552080512 00000100:00100000:0.0:1782728013.029194:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 49 00000100:00100000:0.0:1782728013.029200:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5c39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2352:x1869325552080384:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782728013.029227:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5c39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2352:x1869325552080384:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 27us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728013.029232:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 49 00000100:00100000:0.0:1782728013.029245:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 50 00000100:00100000:0.0:1782728013.029251:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2352:x1869325552080512:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782728013.029274:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5c39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2352:x1869325552080512:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 24us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728013.029280:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 50 00000100:00080000:0.0:1782728013.029295:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782728013.029299:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782728013.029302:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782728013.029703:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552080128 00000100:00100000:1.0:1782728013.029708:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552080128 00000100:00100000:1.0:1782728013.029749:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 244 00000100:00100000:1.0:1782728013.029756:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+10:2352:x1869325552080128:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782728013.029805:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0876850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+10:2352:x1869325552080128:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 50us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728013.029812:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 244 00010000:00010000:1.0:1782728013.805855:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782728014.575081:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728014.575205:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552080640 00000100:00100000:3.0:1782728014.575213:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552080640 00000100:00100000:3.0:1782728014.575262:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 40 00000100:00100000:3.0:1782728014.575269:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5c3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:11654:x1869325552080640:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:3.0:1782728014.575286:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782728014.575303:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0e00/0x22171c6c296150be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20ad7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728014.575354:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c296150c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728014.575491:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c296150c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728014.575500:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c296150c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728014.575577:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1a00/0x22171c6c296150cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728014.575583:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1a00/0x22171c6c296150cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728014.575588:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1a00/0x22171c6c296150cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728014.575820:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c296150c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728014.575826:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c296150c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728014.575830:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c296150c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728014.575834:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f44f1c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1782728014.575837:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c296150c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728014.575842:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c296150c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728014.575851:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d830bf00) 00010000:00010000:3.0:1782728014.575853:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782728014.575856:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c296150c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728014.575860:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c296150c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728014.575868:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1a00/0x22171c6c296150cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728014.575872:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1a00/0x22171c6c296150cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728014.575875:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1a00/0x22171c6c296150cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728014.575882:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f44f1a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1782728014.575884:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1a00/0x22171c6c296150cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728014.575888:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1a00/0x22171c6c296150cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728014.575892:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfd1ea4b6 (ffff8d56c4d03600) 00010000:00010000:3.0:1782728014.575893:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782728014.575895:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1a00/0x22171c6c296150cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728014.575898:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1a00/0x22171c6c296150cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfd1ea4b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728014.576090:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0e00/0x22171c6c296150be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20ad7 expref: 8 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728014.576101:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d830bf00) 00010000:00010000:3.0:1782728014.576103:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782728014.576107:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0e00/0x22171c6c296150be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20ad7 expref: 8 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728014.576127:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f44f0e00, rc 0) 00000100:00100000:3.0:1782728014.576220:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5c3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:11654:x1869325552080640:12345-192.168.202.31@tcp:101:rm.0 Request processed in 950us (1149us total) trans 0 rc 301/301 00000100:00100000:3.0:1782728014.576225:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 40 00010000:00010000:0.0:1782728014.831195:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782728015.853677:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782728016.496329:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572038656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782728016.496394:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869325572038912:0@lo:400:kworker.0 00000100:00100000:0.0:1782728016.496413:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782728016.496420:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782728016.496462:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572039424:0@lo:400:kworker.0 00000100:00100000:2.0:1782728016.496485:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782728016.496527:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782728016.496532:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572038656 00000100:00100000:2.0:1782728016.496534:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869325572039040:0@lo:400:kworker.0 00000100:00100000:1.0:1782728016.496540:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572038656 00000100:00100000:2.0:1782728016.496555:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782728016.496577:0:10280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572038912 00000100:00100000:2.0:1782728016.496580:0:10280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572038912 00000100:00100000:2.0:1782728016.496601:0:10280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572039040 00000100:00100000:1.0:1782728016.496601:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782728016.496603:0:10280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572039040 00000100:00100000:1.0:1782728016.496610:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572038656:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782728016.496620:0:10280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1782728016.496625:0:10280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869325572038912:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1782728016.496641:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782728016.496663:0:10280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869325572038912:12345-0@lo:400:kworker.0 Request processed in 37us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728016.496670:0:10280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782728016.496672:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5c3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572038656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728016.496684:0:10280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1782728016.496690:0:10280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869325572039040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782728016.496707:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782728016.496711:0:10280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869325572039040:12345-0@lo:400:kworker.0 Request processed in 22us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728016.496717:0:10280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1782728016.496737:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782728016.496742:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782728016.496747:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1869325572039040:0@lo:400:kworker.0 00000100:00100000:1.0:1782728016.496751:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572039424 00000100:00100000:1.0:1782728016.496753:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572039424 00000100:00100000:2.0:1782728016.496757:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869325572038912:0@lo:400:kworker.0 00000100:00100000:1.0:1782728016.496780:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782728016.496787:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff895c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572039424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782728016.496818:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff895c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572039424:12345-0@lo:400:kworker.0 Request processed in 32us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728016.496823:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1782728016.496835:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782728016.496855:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572039424:0@lo:400:kworker.0 00000100:00100000:3.0:1782728016.497362:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3315:1869325572038784:0@lo:400:kworker.0 00000100:00100000:3.0:1782728016.497412:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782728016.497440:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869325572039296:0@lo:400:kworker.0 00000100:00100000:3.0:1782728016.497458:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782728016.497475:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782728016.497480:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572039168:0@lo:400:kworker.0 00000100:00100000:3.0:1782728016.497496:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782728016.497540:0:8323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572039168 00000100:00100000:3.0:1782728016.497544:0:8323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572039168 00000100:00100000:3.0:1782728016.497566:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782728016.497581:0:8323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d9f5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572039168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782728016.497610:0:8323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d9f5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572039168:12345-0@lo:400:kworker.0 Request processed in 39us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728016.497616:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782728016.497650:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572039168:0@lo:400:kworker.0 00000100:00100000:1.0:1782728016.497979:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572039296 00000100:00100000:1.0:1782728016.497983:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572039296 00000100:00100000:1.0:1782728016.498009:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1782728016.498015:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d9f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869325572039296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782728016.498056:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d9f5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869325572039296:12345-0@lo:400:kworker.0 Request processed in 42us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728016.498062:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1782728016.498074:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782728016.498219:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869325572039296:0@lo:400:kworker.0 00000100:00100000:2.0:1782728016.502745:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572038784 00000100:00100000:2.0:1782728016.502760:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572038784 00000100:00100000:2.0:1782728016.502829:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1782728016.502837:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0876450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3315:x1869325572038784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782728016.502939:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0876450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3315:x1869325572038784:12345-0@lo:400:kworker.0 Request processed in 102us (5525us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728016.502947:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1782728016.506149:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3315:1869325572038784:0@lo:400:kworker.0 00000100:00100000:0.0:1782728016.506448:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f59e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572038656:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782728016.879289:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782728017.005970:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782728017.005995:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d9f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572039552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782728017.006067:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782728017.006437:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572039552 00000100:00100000:3.0:1782728017.006446:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572039552 00000100:00100000:3.0:1782728017.006503:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782728017.006542:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572039552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782728017.006577:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782728017.006628:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ae3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572039552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728017.006635:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782728017.006718:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d9f5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572039552:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1782728017.650844:0:12050:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 118c: Fsync blocks on EROFS until dirty pages are flushed ==================================================================== 06:13:35 (1782728015) 00010000:00010000:0.0:1782728017.911158:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782728018.144937:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728018.144983:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728018.145068:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728018.145299:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552080768 00000100:00100000:0.0:1782728018.145310:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552080768 00000100:00100000:0.0:1782728018.145361:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 246 00000100:00100000:0.0:1782728018.145378:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0875050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+10:2354:x1869325552080768:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782728018.145447:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0875050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b661aafc-708f-4f38-b71b-eec242d406b4+10:2354:x1869325552080768:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 78us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728018.145455:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 246 00000100:00100000:2.0:1782728018.145713:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552080896 00000100:00100000:2.0:1782728018.145718:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552080896 00000100:00100000:2.0:1782728018.145769:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 115 00000100:00100000:2.0:1782728018.145777:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d9f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:2355:x1869325552080896:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782728018.145812:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d9f5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:2355:x1869325552080896:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 37us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728018.145818:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 115 00000100:00080000:0.0:1782728018.146098:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782728018.146407:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552081024 00000100:00100000:1.0:1782728018.146413:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552081024 00000100:00100000:1.0:1782728018.146464:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 53 00000100:00100000:1.0:1782728018.146473:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c743b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2354:x1869325552081024:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782728018.146535:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c743b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2354:x1869325552081024:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 65us (1466us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728018.146542:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 53 00000100:00080000:0.0:1782728018.146944:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782728018.148791:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728018.148873:0:8323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552081152 00000100:00100000:3.0:1782728018.148880:0:8323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552081152 00000100:00100000:3.0:1782728018.148943:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 54 00000100:00100000:3.0:1782728018.148953:0:8323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2355:x1869325552081152:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782728018.149019:0:8323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5c39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2355:x1869325552081152:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 68us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728018.149026:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 54 00000100:00080000:0.0:1782728018.149492:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782728018.851771:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782728018.851870:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552081408 00000100:00100000:2.0:1782728018.851880:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552081408 00000100:00100000:2.0:1782728018.851942:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 41 00000100:00100000:2.0:1782728018.851952:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:11905:x1869325552081408:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782728018.851970:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782728018.851973:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782728018.851999:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c296150b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20ad0 expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.852032:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d830bf00) 00010000:00010000:2.0:1782728018.852043:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782728018.852059:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c296150d3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20ade expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.852385:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c296150da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.852398:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c296150da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.852408:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c296150da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.852421:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c296150e1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.852427:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c296150e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.852434:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c296150e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.853412:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c296150e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.853424:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c296150e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.853433:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c296150e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782728018.853448:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 0 00010000:00010000:2.0:1782728018.853473:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c296150da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.853480:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c296150da lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.853487:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c296150da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.853493:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3ce600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1782728018.853497:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c296150da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.853504:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c296150da lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.853538:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c9dbb300) 00010000:00010000:2.0:1782728018.853542:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782728018.853545:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c296150da lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.853551:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c296150da lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782728018.853564:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c0f8e8ff reply state 00000000398391f3 transno 4294967314 ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c296150e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782728018.853572:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782728018.853598:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c296150d3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20ade expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.853626:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c296150e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20ade expref: 8 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.853634:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8d56c9dbbf00) 00010000:00010000:2.0:1782728018.853636:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782728018.853639:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3cee00, rc 0) 00000100:00100000:2.0:1782728018.853696:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+9:11905:x1869325552081408:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 1745us (1934us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1782728018.853705:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 41 00010000:00010000:3.0:1782728018.857985:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c296150e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728018.858001:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c296150e1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728018.858008:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c296150e1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728018.858014:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3ce400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1782728018.858019:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c296150e1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728018.858026:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c296150e1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728018.858041:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff8d56c9dbbc00) 00010000:00010000:3.0:1782728018.858045:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782728018.858062:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c296150e1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728018.858068:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c296150e1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782728018.866789:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782728018.866873:0:10280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552081664 00000100:00100000:2.0:1782728018.866882:0:10280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552081664 00000100:00100000:2.0:1782728018.866940:0:10280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 42 00000100:00100000:2.0:1782728018.866949:0:10280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:11905:x1869325552081664:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782728018.866973:0:10280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782728018.866993:0:10280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c296150f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20ae5 expref: -99 pid: 10280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.867107:0:10280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c296150fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.867123:0:10280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c296150e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20ade expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.867132:0:10280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c296150fd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.867164:0:10280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c296150e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20ade expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.867193:0:10280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c296150e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20ade expref: 9 pid: 5808 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782728018.867207:0:10280:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5ae2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10280:1869325572039680:192.168.202.31@tcp:104: 00000100:00100000:2.0:1782728018.867301:0:10280:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c75f4000 going to sleep for 11 seconds 00000100:00100000:0.0:1782728018.871125:0:10280:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5ae2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10280:1869325572039680:192.168.202.31@tcp:104: 00010000:00010000:0.0:1782728018.871163:0:10280:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c296150fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782728018.871653:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728018.871715:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552081792 00000100:00100000:3.0:1782728018.871722:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552081792 00010000:00010000:3.0:1782728018.871755:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c296150e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20ade expref: 10 pid: 5808 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782728018.871788:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 30 00000100:00100000:3.0:1782728018.871796:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9935180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+10:2352:x1869325552081792:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782728018.871809:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782728018.871815:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c296150e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20ade expref: 10 pid: 5808 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728018.871826:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c296150e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20ade expref: 10 pid: 5808 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728018.871847:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c296150e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20ade expref: 10 pid: 5808 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728018.871865:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8d56c9dbbf00) 00010000:00010000:3.0:1782728018.871869:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c296150fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728018.871878:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c296150fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728018.871902:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c296150fd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728018.871965:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782728018.872013:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9935180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+9:2352:x1869325552081792:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 217us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728018.872019:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 30 00010000:00010000:2.0:1782728018.874595:0:10280:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c296150fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.874611:0:10280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c296150fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782728018.874631:0:10280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 0 00000004:00080000:2.0:1782728018.874912:0:10280:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00000004:00080000:2.0:1782728018.874920:0:10280:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1782728018.875042:0:10280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c296150fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.875050:0:10280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c296150fd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.875058:0:10280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c296150fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.876250:0:10280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3ce600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1782728018.876255:0:10280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c296150fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.876265:0:10280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c296150fd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.876293:0:10280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8d56c9dbbf00) 00010000:00010000:2.0:1782728018.876296:0:10280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782728018.876301:0:10280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c296150fd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.876308:0:10280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c296150fd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.877260:0:10280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c296150f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20ae5 expref: 9 pid: 10280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.877274:0:10280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c9dbb300) 00010000:00010000:2.0:1782728018.877277:0:10280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782728018.877281:0:10280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c296150f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20ae5 expref: 9 pid: 10280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.877297:0:10280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3cfa00, rc 0) 00000100:00100000:2.0:1782728018.877469:0:10280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:11905:x1869325552081664:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 10520us (10690us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1782728018.877478:0:10280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 42 00000100:00100000:0.0:1782728018.892752:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728018.893178:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552082048 00000100:00100000:3.0:1782728018.893188:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552082048 00000100:00100000:3.0:1782728018.893246:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 8 00000100:00100000:3.0:1782728018.893256:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:11905:x1869325552082048:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:3.0:1782728018.893999:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+9:11905:x1869325552082048:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 742us (1253us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1782728018.894008:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 8 00000100:00100000:0.0:1782728018.902748:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782728018.902848:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552082176 00000100:00100000:2.0:1782728018.902858:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552082176 00000100:00100000:2.0:1782728018.902919:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 43 00000100:00100000:2.0:1782728018.902929:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+9:11905:x1869325552082176:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782728018.902950:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782728018.902973:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c2961510b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20aec expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.903060:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c2961510b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20aec expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.903096:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c2961510b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20aec expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728018.903115:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8d56c9dbb300) 00010000:00010000:2.0:1782728018.903118:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782728018.903121:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3cfa00, rc 0) 00000100:00100000:2.0:1782728018.903185:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+10:11905:x1869325552082176:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 258us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728018.903191:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 43 00000100:00100000:1.0:1782728018.912289:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728018.912421:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552082432 00000100:00100000:0.0:1782728018.912431:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552082432 00000100:00100000:0.0:1782728018.912492:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 9 00000100:00100000:0.0:1782728018.912503:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+10:11905:x1869325552082432:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:0.0:1782728018.912777:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+11:11905:x1869325552082432:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 275us (496us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1782728018.912785:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 9 00010000:00010000:0.0:1782728018.927967:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782728018.942019:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728018.942336:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552082560 00000100:00100000:1.0:1782728018.942347:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552082560 00000100:00100000:1.0:1782728018.942422:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 44 00000100:00100000:1.0:1782728018.942431:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c7439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+11:11906:x1869325552082560:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1782728018.942454:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782728018.942477:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0e00/0x22171c6c29615112 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20af3 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728018.942567:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1800/0x22171c6c29615119 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728018.942581:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1800/0x22171c6c29615119 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728018.942593:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1800/0x22171c6c29615119 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782728018.942654:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782728018.942658:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1782728018.942682:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1800/0x22171c6c29615119 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728018.942705:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0e00/0x22171c6c29615112 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20af3 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728018.942722:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1800/0x22171c6c29615119 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20af3 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728018.942730:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d03b0f00) 00010000:00010000:1.0:1782728018.942733:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782728018.942750:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f94b1800, rc 0) 00000100:00100000:1.0:1782728018.942804:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c7439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+12:11906:x1869325552082560:12345-192.168.202.31@tcp:101:dd.0 Request processed in 374us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728018.942811:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 44 00000100:00100000:2.0:1782728018.955667:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728018.955815:0:10280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552082816 00000100:00100000:0.0:1782728018.955825:0:10280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552082816 00000100:00100000:0.0:1782728018.955890:0:10280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 45 00000100:00100000:0.0:1782728018.955900:0:10280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+12:11906:x1869325552082816:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1782728018.955920:0:10280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782728018.955923:0:10280:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782728018.955947:0:10280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1800/0x22171c6c29615119 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20af3 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.955965:0:10280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d03b0f00) 00010000:00010000:0.0:1782728018.955976:0:10280:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782728018.955991:0:10280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29615120 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20afa expref: -99 pid: 10280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.956170:0:10280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c29615127 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.956185:0:10280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c29615127 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.956194:0:10280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c29615127 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.956207:0:10280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c2961512e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.956214:0:10280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c2961512e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.956220:0:10280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c2961512e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.956306:0:10280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29615135 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.956316:0:10280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29615135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.956323:0:10280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29615135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782728018.956331:0:10280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 0 00010000:00010000:0.0:1782728018.956871:0:10280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c29615127 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.956880:0:10280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c29615127 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.956887:0:10280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c29615127 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.956893:0:10280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56c0030a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1782728018.956898:0:10280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c29615127 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.956904:0:10280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c29615127 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.956914:0:10280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d830b100) 00010000:00010000:0.0:1782728018.956917:0:10280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782728018.956921:0:10280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c29615127 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.956936:0:10280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c29615127 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.956949:0:10280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c2961512e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.956955:0:10280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c2961512e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.956960:0:10280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c2961512e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.956964:0:10280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56c0030800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1782728018.956966:0:10280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c2961512e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.956971:0:10280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c2961512e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.956978:0:10280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff8d56d830b600) 00010000:00010000:0.0:1782728018.956980:0:10280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782728018.956983:0:10280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c2961512e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.956989:0:10280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c2961512e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.957042:0:10280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29615120 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20afa expref: 14 pid: 10280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.957072:0:10280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29615135 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20afa expref: 13 pid: 10280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.957089:0:10280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8d56c9dbb300) 00010000:00010000:0.0:1782728018.957092:0:10280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782728018.957094:0:10280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56c0030e00, rc 0) 00000100:00100000:0.0:1782728018.957164:0:10280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+13:11906:x1869325552082816:12345-192.168.202.31@tcp:101:dd.0 Request processed in 1258us (1499us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1782728018.957172:0:10280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 45 00000100:00100000:2.0:1782728018.962986:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728018.963083:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552083072 00000100:00100000:0.0:1782728018.963094:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552083072 00000100:00100000:0.0:1782728018.963151:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 46 00000100:00100000:0.0:1782728018.963171:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+13:11906:x1869325552083072:12345-192.168.202.31@tcp:36:dd.0 00010000:00010000:0.0:1782728018.963229:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782728018.963255:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030e00/0x22171c6c29615135 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20afa expref: 13 pid: 10280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.963274:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8d56c9dbb300) 00010000:00010000:0.0:1782728018.963279:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782728018.963554:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29615143 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.963569:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29615143 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.963578:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29615143 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782728018.963640:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000004:00010000:0.0:1782728018.963677:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005ed5ad39 reply state 000000003af1be84 transno 4294967320 ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29615143 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782728018.963685:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782728018.964049:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+15:11906:x1869325552083072:12345-192.168.202.31@tcp:36:dd.0 Request processed in 879us (1073us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1782728018.964056:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 46 00000020:00080000:0.0:1782728018.964061:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782728018.966096:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29615143 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728018.966111:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29615143 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728018.966119:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29615143 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728018.966125:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56c0031800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1782728018.966130:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29615143 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728018.966137:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29615143 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728018.966152:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8d56c9dbb300) 00010000:00010000:1.0:1782728018.966155:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782728018.966159:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29615143 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728018.966164:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29615143 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782728018.967410:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728018.967558:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552083200 00000100:00100000:1.0:1782728018.967567:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552083200 00000100:00100000:1.0:1782728018.967613:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 20 00000100:00100000:1.0:1782728018.967622:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:11906:x1869325552083200:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1782728018.967651:0:6606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782728018.967673:0:6606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094408287/0x22171c6c2961514a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20b01 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782728018.967699:0:6606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782728018.967719:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=342s v=(0 0) 00010000:00010000:1.0:1782728018.967723:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782728018.967731:0:6606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094408287/0x22171c6c2961514a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b01 expref: 7 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728018.967748:0:6606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000094408287/0x22171c6c2961514a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b01 expref: 7 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728018.967760:0:6606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f94b0e00, rc 0) 00000100:00100000:1.0:1782728018.967860:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:11906:x1869325552083200:12345-192.168.202.31@tcp:101:dd.0 Request processed in 239us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728018.967868:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 20 00000100:00100000:3.0:1782728018.971397:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728018.971665:0:8323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552083328 00000100:00100000:0.0:1782728018.971674:0:8323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552083328 00000100:00100000:0.0:1782728018.971728:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 21 00000100:00100000:0.0:1782728018.971737:0:8323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c743ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:11906:x1869325552083328:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1782728018.971753:0:8323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782728018.971774:0:8323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040554eb3/0x22171c6c29615151 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20b08 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782728018.971796:0:8323:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782728018.971814:0:8323:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=342s v=(0 0) 00010000:00010000:0.0:1782728018.971817:0:8323:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782728018.971822:0:8323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040554eb3/0x22171c6c29615151 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b08 expref: 6 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.971834:0:8323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040554eb3/0x22171c6c29615151 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b08 expref: 6 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728018.971855:0:8323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56c0030e00, rc 0) 00000100:00100000:0.0:1782728018.972008:0:8323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c743ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:11906:x1869325552083328:12345-192.168.202.31@tcp:101:dd.0 Request processed in 272us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728018.972014:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 21 00000100:00100000:3.0:1782728018.981941:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728018.982005:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728018.982086:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552083456 00000100:00100000:0.0:1782728018.982095:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552083456 00002000:00010000:0.0:1782728018.982133:0:6611:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/4 (0->18446744073709551615) 00002000:00100000:0.0:1782728018.982137:0:6611:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d56c7439500 with x1869325552083456 ext(0->18446744073709551615) 00002000:00010000:0.0:1782728018.982146:0:6611:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d56c7439500. 00000100:00100000:0.0:1782728018.982167:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552083584 00000100:00100000:0.0:1782728018.982170:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552083584 00002000:00010000:0.0:1782728018.982182:0:6611:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1782728018.982185:0:6611:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d56c7438380 with x1869325552083584 ext(0->18446744073709551615) 00002000:00010000:0.0:1782728018.982190:0:6611:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d56c7438380. 00000100:00100000:3.0:1782728018.982198:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 0 00000100:00100000:3.0:1782728018.982209:0:6612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c7439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:2352:x1869325552083456:12345-192.168.202.31@tcp:10:dd.0 00002000:00010000:3.0:1782728018.983011:0:6612:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1782728018.983016:0:6612:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1782728019 00002000:00010000:3.0:1782728018.983019:0:6612:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1782728018.983104:0:6612:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1782728019 00002000:00010000:3.0:1782728018.983106:0:6612:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1782728018.983221:0:6612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c7439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:2352:x1869325552083456:12345-192.168.202.31@tcp:10:dd.0 Request processed in 1012us (1286us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1782728018.985102:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 0 00002000:00010000:3.0:1782728018.985110:0:6612:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/4 (0->18446744073709551615) 00002000:00100000:3.0:1782728018.985114:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d56c7439500 with x1869325552083456 ext(0->18446744073709551615) 00002000:00010000:3.0:1782728018.985124:0:6612:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d56c7439500. 00000100:00100000:3.0:1782728018.985153:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1 00000100:00100000:3.0:1782728018.985167:0:6612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c7438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2352:x1869325552083584:12345-192.168.202.31@tcp:10:dd.0 00002000:00010000:0.0:1782728018.985906:0:6612:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1782728018.985909:0:6612:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1782728019 00002000:00010000:0.0:1782728018.985911:0:6612:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1782728018.985913:0:6612:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1782728019 00002000:00010000:0.0:1782728018.985914:0:6612:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1782728018.986010:0:6612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c7438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:2352:x1869325552083584:12345-192.168.202.31@tcp:10:dd.0 Request processed in 848us (4003us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1782728018.986014:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1 00002000:00010000:0.0:1782728018.986017:0:6612:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1782728018.986019:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d56c7438380 with x1869325552083584 ext(0->18446744073709551615) 00002000:00010000:0.0:1782728018.986025:0:6612:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d56c7438380. 00000100:00100000:3.0:1782728019.006593:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782728019.006865:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552083712 00000100:00100000:2.0:1782728019.006875:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552083712 00002000:00100000:2.0:1782728019.006923:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->65535) req@ffff8d56c743a680 x1869325552083712/t0(0) o4->f9926b93-a1e5-4dad-ade1-7cd7c966fac6@192.168.202.31@tcp:135/0 lens 488/0 e 0 to 0 dl 1782728030 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782728019.006933:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d56c743a680 with x1869325552083712 ext(0->65535) 00002000:00010000:2.0:1782728019.006940:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d56c743a680 00000100:00100000:2.0:1782728019.006973:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2 00000100:00100000:2.0:1782728019.006982:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c743a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:2355:x1869325552083712:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:0.0:1782728019.030543:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c743a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+10:2355:x1869325552083712:12345-192.168.202.31@tcp:4:dd.0 Request processed in 23551us (23949us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1782728019.030567:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2 00002000:00100000:0.0:1782728019.030579:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->65535) req@ffff8d56c743a680 x1869325552083712/t4294967302(0) o4->f9926b93-a1e5-4dad-ade1-7cd7c966fac6@192.168.202.31@tcp:135/0 lens 488/448 e 0 to 0 dl 1782728030 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782728019.030589:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d56c743a680 with x1869325552083712 ext(0->65535) 00002000:00010000:0.0:1782728019.030596:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d56c743a680 00000100:00100000:1.0:1782728019.041282:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728019.041489:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552083968 00000100:00100000:0.0:1782728019.041501:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552083968 00000100:00100000:0.0:1782728019.041601:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 10 00000100:00100000:0.0:1782728019.041611:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56e0581850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+14:11906:x1869325552083968:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:0.0:1782728019.041966:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56e0581850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+15:11906:x1869325552083968:12345-192.168.202.31@tcp:35:dd.0 Request processed in 355us (692us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1782728019.041975:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 10 00000100:00100000:2.0:1782728019.071329:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728019.072860:0:6612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552084096 00000100:00100000:1.0:1782728019.072873:0:6612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552084096 00002000:00100000:1.0:1782728019.072919:0:6612:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (65536->131071) req@ffff8d56f59e4380 x1869325552084096/t0(0) o4->f9926b93-a1e5-4dad-ade1-7cd7c966fac6@192.168.202.31@tcp:135/0 lens 488/0 e 0 to 0 dl 1782728030 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782728019.072931:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d56f59e4380 with x1869325552084096 ext(65536->131071) 00002000:00010000:1.0:1782728019.072936:0:6612:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d56f59e4380 00000100:00100000:1.0:1782728019.072962:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3 00000100:00100000:1.0:1782728019.072972:0:6612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+10:2352:x1869325552084096:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:3.0:1782728019.084065:0:6612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+12:2352:x1869325552084096:12345-192.168.202.31@tcp:4:dd.0 Request processed in 11084us (12736us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1782728019.084087:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3 00002000:00100000:3.0:1782728019.084100:0:6612:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (65536->131071) req@ffff8d56f59e4380 x1869325552084096/t4294967303(0) o4->f9926b93-a1e5-4dad-ade1-7cd7c966fac6@192.168.202.31@tcp:135/0 lens 488/448 e 0 to 0 dl 1782728030 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782728019.084111:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d56f59e4380 with x1869325552084096 ext(65536->131071) 00002000:00010000:3.0:1782728019.084118:0:6612:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d56f59e4380 00000100:00100000:2.0:1782728019.107918:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728019.110802:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552084224 00000100:00100000:3.0:1782728019.110816:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552084224 00000100:00100000:3.0:1782728019.110876:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 47 00000100:00100000:3.0:1782728019.110886:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+15:11908:x1869325552084224:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:3.0:1782728019.110910:0:7031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782728019.110933:0:7031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0e00/0x22171c6c29615158 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20b0f expref: -99 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728019.110993:0:7031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1a00/0x22171c6c2961515f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728019.111149:0:7031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1a00/0x22171c6c2961515f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728019.111218:0:7031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1a00/0x22171c6c2961515f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782728019.111394:0:7031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782728019.111398:0:7031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1782728019.111480:0:7031:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1a00/0x22171c6c2961515f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728019.111537:0:7031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0e00/0x22171c6c29615158 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b0f expref: 17 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728019.111557:0:7031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1a00/0x22171c6c2961515f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b0f expref: 16 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728019.111566:0:7031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c4d03600) 00010000:00010000:3.0:1782728019.111569:0:7031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782728019.111572:0:7031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f44f1a00, rc 0) 00000100:00100000:3.0:1782728019.111632:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+16:11908:x1869325552084224:12345-192.168.202.31@tcp:101:rm.0 Request processed in 747us (3724us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728019.111639:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 47 00000100:00100000:2.0:1782728019.121924:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728019.122004:0:10280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552084352 00000100:00100000:0.0:1782728019.122024:0:10280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552084352 00000100:00100000:0.0:1782728019.122096:0:10280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 48 00000100:00100000:0.0:1782728019.122105:0:10280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+16:11908:x1869325552084352:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:0.0:1782728019.122124:0:10280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782728019.122143:0:10280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c29615166 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20b16 expref: -99 pid: 10280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122203:0:10280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c2961516d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122217:0:10280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c2961516d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122236:0:10280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c2961516d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122250:0:10280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29615174 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122256:0:10280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29615174 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122262:0:10280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29615174 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122607:0:10280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6800/0x22171c6c2961517b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122617:0:10280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6800/0x22171c6c2961517b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122625:0:10280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6800/0x22171c6c2961517b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782728019.122657:0:10280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 131072 00000004:00200000:0.0:1782728019.122661:0:10280:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782728019.122690:0:10280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6800/0x22171c6c2961517b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122701:0:10280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6800/0x22171c6c2961517b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122710:0:10280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c2961516d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122725:0:10280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c2961516d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122731:0:10280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c2961516d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122737:0:10280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56c0030800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1782728019.122741:0:10280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c2961516d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122748:0:10280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c2961516d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122761:0:10280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c4d03600) 00010000:00010000:0.0:1782728019.122764:0:10280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782728019.122769:0:10280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c2961516d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122775:0:10280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030800/0x22171c6c2961516d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122787:0:10280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29615174 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122793:0:10280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29615174 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122799:0:10280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29615174 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122804:0:10280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56c0031800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1782728019.122814:0:10280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29615174 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122820:0:10280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29615174 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122828:0:10280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff8d56d830b400) 00010000:00010000:0.0:1782728019.122830:0:10280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782728019.122833:0:10280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29615174 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122839:0:10280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0031800/0x22171c6c29615174 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122873:0:10280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56c0030a00/0x22171c6c29615166 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b16 expref: 18 pid: 10280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122887:0:10280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6800/0x22171c6c2961517b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b16 expref: 17 pid: 10280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.122895:0:10280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8d56c9dbb300) 00010000:00010000:0.0:1782728019.122897:0:10280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782728019.122900:0:10280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f9af6800, rc 0) 00000100:00100000:0.0:1782728019.122954:0:10280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+17:11908:x1869325552084352:12345-192.168.202.31@tcp:101:rm.0 Request processed in 850us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728019.122961:0:10280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 48 00000100:00100000:2.0:1782728019.139375:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782728019.139410:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552084608 00000100:00100000:2.0:1782728019.139418:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552084608 00000100:00100000:2.0:1782728019.139471:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 49 00000100:00100000:2.0:1782728019.139481:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+17:11908:x1869325552084608:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:2.0:1782728019.139556:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1782728019.139580:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6800/0x22171c6c2961517b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b16 expref: 17 pid: 10280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.139601:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cfa00/0x22171c6c2961510b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20aec expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.139613:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8d56c9dbb300) 00010000:00010000:2.0:1782728019.139627:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1a00/0x22171c6c2961515f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b0f expref: 15 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.139636:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c4d03600) 00010000:00010000:2.0:1782728019.139641:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782728019.139664:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29615182 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.139677:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29615182 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.139686:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29615182 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.139697:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c29615189 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.139717:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c29615189 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.139724:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c29615189 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.140760:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29615190 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.140775:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29615190 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.140784:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29615190 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782728019.141627:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967321 is committed 00000040:00080000:2.0:1782728019.142831:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1782728019.142843:0:5807:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343096332725ns, next at 344096330248ns, rc = 0 00000040:00080000:2.0:1782728019.142890:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1782728019.142896:0:5807:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343096386983ns, next at 344096386043ns, rc = 0 00010000:00010000:2.0:1782728019.143001:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29615197 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.143015:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29615197 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.144191:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29615197 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.144206:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29615197 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.144227:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29615197 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.144233:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29615197 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.144294:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782728019.144319:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29615190 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.144326:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29615190 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.144332:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29615190 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.144338:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3cf800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1782728019.144342:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29615190 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.144348:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29615190 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.144368:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8d56c9dbb400) 00010000:00010000:2.0:1782728019.144371:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782728019.144376:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29615190 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.144382:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf800/0x22171c6c29615190 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.144403:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29615182 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.144414:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29615182 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.144420:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29615182 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.144424:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3ce400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:2.0:1782728019.144427:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29615182 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.144434:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29615182 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.144442:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c9dbbf00) 00010000:00010000:2.0:1782728019.144444:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782728019.144447:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29615182 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728019.144452:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c29615182 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782728019.144470:0:5807:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aa0e4229 reply state 0000000044cf1ee4 transno 4294967322 ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c29615189 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782728019.144480:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782728019.144591:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:11908:x1869325552084608:12345-192.168.202.31@tcp:36:rm.0 Request processed in 5107us (5230us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1782728019.144601:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 49 00010000:00010000:3.0:1782728019.153321:0:8303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782728019.153336:0:8303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29615197 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728019.153347:0:8303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3cee00 already unused, calling callback (ffffffffc152fcf0) 00010000:00010000:3.0:1782728019.153352:0:8303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29615197 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728019.154555:0:8303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29615197 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728019.154576:0:8303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8d56c9dbb400) 00010000:00010000:3.0:1782728019.154579:0:8303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782728019.154583:0:8303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29615197 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728019.154590:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29615197 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.155175:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782728019.155179:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782728019.155181:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782728019.160274:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c29615189 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728019.160292:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c29615189 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728019.160299:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c29615189 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728019.160306:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3cf400 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1782728019.160311:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c29615189 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728019.160318:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c29615189 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728019.160334:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff8d56c9dbb900) 00010000:00010000:3.0:1782728019.160337:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782728019.160341:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c29615189 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728019.160379:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c29615189 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728019.954461:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782728020.405476:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728020.405607:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552084736 00000100:00100000:3.0:1782728020.405616:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552084736 00000100:00100000:3.0:1782728020.405695:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 50 00000100:00100000:3.0:1782728020.405705:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f59e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:11951:x1869325552084736:12345-192.168.202.31@tcp:101:multiop.0 00010000:00010000:3.0:1782728020.405731:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782728020.405756:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0e00/0x22171c6c2961519e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20b1d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728020.405818:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c296151a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728020.405832:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c296151a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728020.405845:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c296151a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782728020.405905:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782728020.405909:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1782728020.405945:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c296151a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728020.405964:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0e00/0x22171c6c2961519e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b1d expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728020.405978:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c296151a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b1d expref: 8 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728020.405995:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c4d03c00) 00010000:00010000:3.0:1782728020.405998:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782728020.406001:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f44f1c00, rc 0) 00000100:00080000:1.0:1782728020.406108:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782728020.406110:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f59e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:11951:x1869325552084736:12345-192.168.202.31@tcp:101:multiop.0 Request processed in 407us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728020.406118:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 50 00000100:00100000:0.0:1782728020.412021:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728020.412105:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552084992 00000100:00100000:1.0:1782728020.412116:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552084992 00000100:00100000:1.0:1782728020.412205:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 51 00000100:00100000:1.0:1782728020.412217:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:11951:x1869325552084992:12345-192.168.202.31@tcp:101:multiop.0 00010000:00010000:1.0:1782728020.412242:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782728020.412245:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782728020.412272:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1c00/0x22171c6c296151a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b1d expref: 8 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728020.412288:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c4d03c00) 00010000:00010000:1.0:1782728020.412297:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782728020.412313:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1400/0x22171c6c296151ac lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20b24 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728020.412451:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0000/0x22171c6c296151b3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728020.412463:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0000/0x22171c6c296151b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728020.412472:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0000/0x22171c6c296151b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728020.412506:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0a00/0x22171c6c296151ba lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728020.412530:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0a00/0x22171c6c296151ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728020.412557:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0a00/0x22171c6c296151ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782728020.413108:0:5808:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1782728020.413283:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1000/0x22171c6c296151c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728020.413294:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1000/0x22171c6c296151c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728020.413301:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1000/0x22171c6c296151c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728020.413336:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0000/0x22171c6c296151b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728020.413343:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0000/0x22171c6c296151b3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728020.413349:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0000/0x22171c6c296151b3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728020.413354:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f94b0000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1782728020.413358:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0000/0x22171c6c296151b3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728020.413365:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0000/0x22171c6c296151b3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728020.413375:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d03b0100) 00010000:00010000:1.0:1782728020.413378:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782728020.413388:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0000/0x22171c6c296151b3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728020.413396:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0000/0x22171c6c296151b3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782728020.413409:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d97d38f7 reply state 000000003db97ea0 transno 4294967323 ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0a00/0x22171c6c296151ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782728020.413418:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782728020.413445:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1400/0x22171c6c296151ac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b24 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728020.413461:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1000/0x22171c6c296151c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b24 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728020.413468:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d56d03b0600) 00010000:00010000:1.0:1782728020.413470:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782728020.413472:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f94b1000, rc 0) 00000100:00100000:1.0:1782728020.413576:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+10:11951:x1869325552084992:12345-192.168.202.31@tcp:101:multiop.0 Request processed in 1361us (1564us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1782728020.413585:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 51 00010000:00010000:0.0:1782728020.415715:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0a00/0x22171c6c296151ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728020.415730:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0a00/0x22171c6c296151ba lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728020.415738:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0a00/0x22171c6c296151ba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728020.415745:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f94b0a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1782728020.415749:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0a00/0x22171c6c296151ba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728020.415756:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0a00/0x22171c6c296151ba lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728020.415772:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x11a4e1a9 (ffff8d56d03b0300) 00010000:00010000:0.0:1782728020.415775:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782728020.415779:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0a00/0x22171c6c296151ba lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728020.415786:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0a00/0x22171c6c296151ba lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782728020.421565:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728020.423405:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552085120 00000100:00100000:1.0:1782728020.423420:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552085120 00000100:00080000:0.0:1782728020.423481:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782728020.423502:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 22 00000100:00100000:1.0:1782728020.423536:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+12:11951:x1869325552085120:12345-192.168.202.31@tcp:101:multiop.0 00010000:00010000:1.0:1782728020.423565:0:6606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782728020.423588:0:6606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091f3bc2d/0x22171c6c296151cf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20b2b expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782728020.423628:0:6606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782728020.423650:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=344s v=(0 0) 00010000:00010000:1.0:1782728020.423655:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782728020.423674:0:6606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091f3bc2d/0x22171c6c296151cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b2b expref: 13 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728020.423694:0:6606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000091f3bc2d/0x22171c6c296151cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b2b expref: 13 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728020.423706:0:6606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f94b1400, rc 0) 00000100:00100000:1.0:1782728020.423778:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+13:11951:x1869325552085120:12345-192.168.202.31@tcp:101:multiop.0 Request processed in 267us (2220us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728020.423785:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 22 00000100:00100000:3.0:1782728020.435609:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728020.435802:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552085248 00000100:00100000:0.0:1782728020.435812:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552085248 00002000:00100000:0.0:1782728020.435864:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->4095) req@ffff8d55c368aa00 x1869325552085248/t0(0) o4->f9926b93-a1e5-4dad-ade1-7cd7c966fac6@192.168.202.31@tcp:136/0 lens 4584/0 e 0 to 0 dl 1782728031 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782728020.435874:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d55c368aa00 with x1869325552085248 ext(0->4095) 00002000:00010000:0.0:1782728020.435894:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d55c368aa00 00000100:00100000:0.0:1782728020.435941:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4 00000100:00100000:0.0:1782728020.435951:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d55c368aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+13:2352:x1869325552085248:12345-192.168.202.31@tcp:4:multiop.0 00000001:00020000:0.0:1782728020.435963:0:6610:0:(tgt_handler.c:2756:tgt_brw_write()) cfs_fail_timeout id 216 sleeping for 1000ms 00000001:00080000:1.0:1782728020.687769:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:0.0:1782728020.973924:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00020000:0.0:1782728021.485629:0:6610:0:(tgt_handler.c:2756:tgt_brw_write()) cfs_fail_timeout id 216 awake 00000100:00100000:0.0:1782728021.491575:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d55c368aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+13:2352:x1869325552085248:12345-192.168.202.31@tcp:4:multiop.0 Request processed in 1055614us (1055963us total) trans 0 rc -30/-30 00000100:00100000:0.0:1782728021.491589:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4 00002000:00100000:0.0:1782728021.491603:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->4095) req@ffff8d55c368aa00 x1869325552085248/t0(0) o4->f9926b93-a1e5-4dad-ade1-7cd7c966fac6@192.168.202.31@tcp:136/0 lens 4584/224 e 0 to 0 dl 1782728031 ref 1 fl Complete:/600/0 rc -30/-30 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782728021.491613:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d55c368aa00 with x1869325552085248 ext(0->4095) 00002000:00010000:0.0:1782728021.491620:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d55c368aa00 00000004:00080000:2.0:1782728021.617929:0:6700:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 345571417250ns, next at 346571414696ns, rc = 0 00000100:00100000:0.0:1782728021.618083:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff6ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572039808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782728021.618165:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782728021.618500:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f9ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869325572040192:0@lo:400:kworker.0 00000100:00100000:1.0:1782728021.618568:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782728021.618590:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782728021.618596:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f9ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869325572040064:0@lo:400:kworker.0 00000100:00100000:1.0:1782728021.618619:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728021.618818:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f9ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869325572040320:0@lo:400:kworker.0 00000100:00100000:0.0:1782728021.618845:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728021.618873:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782728021.618879:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f9ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572039936:0@lo:400:kworker.0 00000100:00100000:0.0:1782728021.618904:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728021.618925:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c9953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572040448:0@lo:400:kworker.0 00000100:00100000:0.0:1782728021.618945:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728021.618970:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572039936 00000100:00100000:0.0:1782728021.618976:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572039936 00000100:00100000:0.0:1782728021.619015:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1782728021.619029:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3314:x1869325572039936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782728021.619086:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0852450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3314:x1869325572039936:12345-0@lo:400:kworker.0 Request processed in 57us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728021.619093:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1782728021.619122:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572040448 00000100:00100000:0.0:1782728021.619126:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572040448 00000100:00100000:0.0:1782728021.619155:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782728021.619160:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572040448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782728021.619187:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572040448:12345-0@lo:400:kworker.0 Request processed in 27us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728021.619193:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1782728021.619210:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782728021.619236:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f9ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3314:1869325572039936:0@lo:400:kworker.0 00000100:00100000:0.0:1782728021.619249:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c9953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572040448:0@lo:400:kworker.0 00000100:00100000:1.0:1782728021.619399:0:10280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572040192 00000100:00100000:1.0:1782728021.619402:0:10280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572040192 00000100:00100000:1.0:1782728021.619439:0:10280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572040064 00000100:00100000:1.0:1782728021.619441:0:10280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572040064 00000100:00100000:1.0:1782728021.619458:0:10280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572040320 00000100:00100000:1.0:1782728021.619460:0:10280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572040320 00000100:00100000:1.0:1782728021.619473:0:10280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1782728021.619485:0:10280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c9951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869325572040192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782728021.619552:0:10280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c9951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869325572040192:12345-0@lo:400:kworker.0 Request processed in 68us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728021.619557:0:10280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1782728021.619569:0:10280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1782728021.619575:0:10280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c9952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869325572040064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782728021.619599:0:10280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c9952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869325572040064:12345-0@lo:400:kworker.0 Request processed in 25us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728021.619605:0:10280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1782728021.619614:0:10280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1782728021.619619:0:10280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869325572040320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782728021.619643:0:10280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869325572040320:12345-0@lo:400:kworker.0 Request processed in 24us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728021.619659:0:10280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1782728021.619689:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f9ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869325572040064:0@lo:400:kworker.0 00000100:00100000:1.0:1782728021.619698:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f9ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869325572040192:0@lo:400:kworker.0 00000100:00100000:2.0:1782728021.620660:0:8059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572039808 00000100:00100000:2.0:1782728021.620668:0:8059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572039808 00000100:00100000:2.0:1782728021.620720:0:8059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782728021.620729:0:8059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572039808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782728021.620763:0:8059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782728021.620816:0:8059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9935f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572039808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (2660us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728021.620823:0:8059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1782728021.621202:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782728021.621207:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782728021.621235:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f9ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869325572040320:0@lo:400:kworker.0 00000100:00100000:0.0:1782728021.621255:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff6ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572039808:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1782728021.716040:0:6630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:3.0:1782728021.716074:0:6630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00010000:00010000:1.0:1782728021.998361:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782728022.128030:0:7865:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 346081518107ns, next at 347081515544ns, rc = 0 00000100:00100000:1.0:1782728022.128122:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782728022.128145:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c3689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572040576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782728022.128219:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782728022.128327:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572040576 00000100:00100000:3.0:1782728022.128346:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572040576 00000100:00100000:3.0:1782728022.128399:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782728022.128409:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c9951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572040576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782728022.128447:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782728022.128490:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c9951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572040576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728022.128497:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782728022.129109:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c3689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572040576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782728022.564492:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728022.564796:0:6612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552085376 00000100:00100000:3.0:1782728022.564806:0:6612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552085376 00002000:00100000:3.0:1782728022.564880:0:6612:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->4095) req@ffff8d56ff6ef480 x1869325552085376/t0(0) o4->f9926b93-a1e5-4dad-ade1-7cd7c966fac6@192.168.202.31@tcp:138/0 lens 4584/0 e 0 to 0 dl 1782728033 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782728022.564892:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d56ff6ef480 with x1869325552085376 ext(0->4095) 00002000:00010000:3.0:1782728022.564899:0:6612:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d56ff6ef480 00000100:00100000:3.0:1782728022.564944:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5 00000100:00100000:3.0:1782728022.564967:0:6612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:2353:x1869325552085376:12345-192.168.202.31@tcp:4:multiop.0 00000001:00020000:3.0:1782728022.564980:0:6612:0:(tgt_handler.c:2756:tgt_brw_write()) cfs_fail_timeout id 216 sleeping for 1000ms 00000100:00080000:2.0:1782728022.567410:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00020000:2.0:1782728022.911146:0:6612:0:(tgt_handler.c:2756:tgt_brw_write()) cfs_fail_timeout interrupted 00000100:00100000:2.0:1782728022.919236:0:6612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:2353:x1869325552085376:12345-192.168.202.31@tcp:4:multiop.0 Request processed in 354261us (354743us total) trans 0 rc -30/-30 00000100:00100000:2.0:1782728022.919251:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5 00002000:00100000:2.0:1782728022.919266:0:6612:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->4095) req@ffff8d56ff6ef480 x1869325552085376/t0(0) o4->f9926b93-a1e5-4dad-ade1-7cd7c966fac6@192.168.202.31@tcp:138/0 lens 4584/224 e 0 to 0 dl 1782728033 ref 1 fl Complete:/600/0 rc -30/-30 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782728022.919277:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d56ff6ef480 with x1869325552085376 ext(0->4095) 00002000:00010000:2.0:1782728022.919283:0:6612:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d56ff6ef480 00010000:00010000:0.0:1782728023.023673:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782728023.263283:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728023.263400:0:10280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552085760 00000100:00100000:1.0:1782728023.263412:0:10280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552085760 00000100:00100000:1.0:1782728023.263498:0:10280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 119 00000100:00100000:1.0:1782728023.263548:0:10280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+9:2352:x1869325552085760:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782728023.263647:0:10280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+9:2352:x1869325552085760:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 140us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728023.263655:0:10280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 119 00000100:00100000:0.0:1782728023.263917:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00080000:2.0:1782728023.264067:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782728023.264158:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552085632 00000100:00100000:3.0:1782728023.264164:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552085632 00000100:00100000:3.0:1782728023.264204:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 248 00000100:00100000:3.0:1782728023.264211:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2353:x1869325552085632:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782728023.264255:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2353:x1869325552085632:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 45us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728023.264261:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 248 00000100:00100000:0.0:1782728023.271048:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728023.271146:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728023.271152:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552086016 00000100:00100000:3.0:1782728023.271162:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552086016 00000100:00100000:3.0:1782728023.271235:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552085888 00000100:00100000:3.0:1782728023.271238:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552085888 00000100:00100000:3.0:1782728023.271272:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 56 00000100:00100000:3.0:1782728023.271283:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2352:x1869325552086016:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782728023.271373:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9934700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2352:x1869325552086016:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 92us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728023.271381:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 56 00000100:00100000:3.0:1782728023.271401:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 57 00000100:00100000:3.0:1782728023.271407:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9936d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:2353:x1869325552085888:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782728023.271434:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9936d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:2353:x1869325552085888:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 28us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728023.271440:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 57 00000100:00080000:2.0:1782728023.272260:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782728024.052594:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782728024.317867:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967323 is committed 00000004:00080000:0.0:1782728024.317897:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:0.0:1782728024.317920:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:0.0:1782728024.317940:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:0.0:1782728024.318120:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f9935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572040704:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782728024.318191:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728024.318267:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f9934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572040832:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782728024.318292:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728024.318326:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572040704 00000100:00100000:0.0:1782728024.318332:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572040704 00000100:00100000:0.0:1782728024.318379:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572040832 00000100:00100000:0.0:1782728024.318688:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572040832 00000100:00100000:0.0:1782728024.318716:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782728024.318724:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572040704:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782728024.318750:0:6607:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00010000:00010000:0.0:1782728024.318774:0:6607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000924a3471/0x22171c6c296151d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728024.318797:0:6607:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000094408287/0x22171c6c2961514a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b01 expref: 7 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728024.318806:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=6s v=(0 0) 00010000:00010000:0.0:1782728024.318810:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782728024.318815:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000924a3471/0x22171c6c296151d6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728024.318842:0:6607:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000094408287/0x22171c6c2961514a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b01 expref: 7 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728024.318858:0:6607:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000094408287/0x22171c6c2961514a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b01 expref: 7 pid: 6606 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782728024.318880:0:6607:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f9936680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6607:1869325572040960:192.168.202.31@tcp:104: 00000100:00100000:1.0:1782728024.319040:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782728024.319050:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572040832:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782728024.319063:0:6604:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:1.0:1782728024.319077:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000208d25ea/0x22171c6c296151dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728024.319089:0:6604:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040554eb3/0x22171c6c29615151 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b08 expref: 5 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728024.319096:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1782728024.319099:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782728024.319103:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000208d25ea/0x22171c6c296151dd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728024.319122:0:6604:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040554eb3/0x22171c6c29615151 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b08 expref: 5 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728024.319131:0:6604:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040554eb3/0x22171c6c29615151 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b08 expref: 5 pid: 8323 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782728024.319142:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c9950000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6604:1869325572041088:192.168.202.31@tcp:104: 00000100:00080000:2.0:1782728024.319208:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782728024.319213:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782728024.319364:0:6607:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56f9830e40 going to sleep for 11 seconds 00000004:00080000:3.0:1782728024.319671:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:0.0:1782728024.325080:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56c33ac600 going to sleep for 11 seconds 00000100:00100000:3.0:1782728024.333675:0:6607:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f9936680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6607:1869325572040960:192.168.202.31@tcp:104: 00010000:00010000:3.0:1782728024.333728:0:6607:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000924a3471/0x22171c6c296151d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782728024.333823:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c9950000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6604:1869325572041088:192.168.202.31@tcp:104: 00010000:00010000:0.0:1782728024.333839:0:6604:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000208d25ea/0x22171c6c296151dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782728024.349640:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782728024.349698:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728024.349856:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552086272 00000100:00100000:1.0:1782728024.349877:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552086272 00010000:00010000:1.0:1782728024.349935:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000094408287/0x22171c6c2961514a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b01 expref: 8 pid: 6606 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782728024.349970:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552086144 00000100:00100000:1.0:1782728024.349973:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552086144 00010000:00010000:1.0:1782728024.349987:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040554eb3/0x22171c6c29615151 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b08 expref: 6 pid: 8323 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782728024.350007:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 31 00000100:00100000:1.0:1782728024.350015:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:2352:x1869325552086272:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782728024.350037:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782728024.350044:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000094408287/0x22171c6c2961514a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b01 expref: 8 pid: 6606 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728024.350056:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000094408287/0x22171c6c2961514a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b01 expref: 8 pid: 6606 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728024.350077:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094408287/0x22171c6c2961514a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b01 expref: 8 pid: 6606 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728024.350093:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782728024.350098:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782728024.350103:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000924a3471/0x22171c6c296151d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728024.350113:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000924a3471/0x22171c6c296151d6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728024.350143:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782728024.350187:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:2352:x1869325552086272:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 172us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728024.350195:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 31 00000100:00100000:1.0:1782728024.350210:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 32 00000100:00100000:1.0:1782728024.350215:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0eb3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2352:x1869325552086144:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782728024.350223:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782728024.350227:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040554eb3/0x22171c6c29615151 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b08 expref: 6 pid: 8323 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728024.350237:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040554eb3/0x22171c6c29615151 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b08 expref: 6 pid: 8323 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728024.350250:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040554eb3/0x22171c6c29615151 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b08 expref: 6 pid: 8323 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728024.350261:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782728024.350264:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782728024.350268:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000208d25ea/0x22171c6c296151dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728024.350276:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000208d25ea/0x22171c6c296151dd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728024.350299:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782728024.350313:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0eb3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2352:x1869325552086144:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 98us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728024.350319:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 32 00010000:00010000:0.0:1782728024.350442:0:6604:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000208d25ea/0x22171c6c296151dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728024.350453:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000208d25ea/0x22171c6c296151dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728024.350464:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000208d25ea/0x22171c6c296151dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728024.350472:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000208d25ea/0x22171c6c296151dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728024.350489:0:6604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782728024.350690:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782728024.350696:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000208d25ea/0x22171c6c296151dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728024.350704:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f94b1200 already unused, calling callback (ffffffffc152fcf0) 00010000:00010000:1.0:1782728024.350708:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000208d25ea/0x22171c6c296151dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728024.350716:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000208d25ea/0x22171c6c296151dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728024.350727:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000208d25ea/0x22171c6c296151dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728024.350734:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000208d25ea/0x22171c6c296151dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728024.350750:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782728024.350752:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782728024.350754:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782728024.352112:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1869325572040832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 33060us (33815us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1782728024.352124:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1782728024.352339:0:6607:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000924a3471/0x22171c6c296151d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728024.352351:0:6607:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000924a3471/0x22171c6c296151d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728024.352361:0:6607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000924a3471/0x22171c6c296151d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728024.352370:0:6607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000924a3471/0x22171c6c296151d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728024.352400:0:6607:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782728024.352936:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9937480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1869325572040704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 34211us (34743us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1782728024.352944:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1782728024.353180:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782728024.353595:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782728024.353609:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000924a3471/0x22171c6c296151d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728024.353619:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f9af7000 already unused, calling callback (ffffffffc152fcf0) 00010000:00010000:0.0:1782728024.353623:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000924a3471/0x22171c6c296151d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728024.353631:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000924a3471/0x22171c6c296151d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728024.353648:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000924a3471/0x22171c6c296151d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728024.353656:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000924a3471/0x22171c6c296151d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728024.353676:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782728024.353678:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782728024.353680:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782728024.353716:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d56f9935500/2, rc 0, transno 4294967304 00000100:00100000:0.0:1782728024.353724:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f9935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572040704:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1782728024.355746:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d56f9934a80/2, rc 0, transno 4294967301 00000100:00100000:1.0:1782728024.355759:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f9934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572040832:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782728025.070862:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782728025.319676:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728025.319795:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552085504 00000100:00100000:0.0:1782728025.319805:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552085504 00002000:00100000:0.0:1782728025.319855:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->4095) req@ffff8d56ff6ef100 x1869325552085504/t0(0) o4->f9926b93-a1e5-4dad-ade1-7cd7c966fac6@192.168.202.31@tcp:141/0 lens 4584/0 e 0 to 0 dl 1782728036 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782728025.319866:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d56ff6ef100 with x1869325552085504 ext(0->4095) 00002000:00010000:0.0:1782728025.319886:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d56ff6ef100 00000100:00100000:0.0:1782728025.319934:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 6 00000100:00100000:0.0:1782728025.319944:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:2353:x1869325552085504:12345-192.168.202.31@tcp:4:multiop.0 00000100:00100000:0.0:1782728025.320435:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:2353:x1869325552085504:12345-192.168.202.31@tcp:4:multiop.0 Request processed in 491us (768us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1782728025.320444:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 6 00002000:00100000:0.0:1782728025.320451:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->4095) req@ffff8d56ff6ef100 x1869325552085504/t4294967305(0) o4->f9926b93-a1e5-4dad-ade1-7cd7c966fac6@192.168.202.31@tcp:141/0 lens 4584/448 e 0 to 0 dl 1782728036 ref 1 fl Complete:/600/0 rc 0/0 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782728025.320460:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d56ff6ef100 with x1869325552085504 ext(0->4095) 00002000:00010000:0.0:1782728025.320464:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d56ff6ef100 00000100:00100000:3.0:1782728025.329436:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728025.329551:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552086400 00000100:00100000:0.0:1782728025.329562:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552086400 00000100:00100000:0.0:1782728025.329649:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 52 00000100:00100000:0.0:1782728025.329659:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d55c3689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:11951:x1869325552086400:12345-192.168.202.31@tcp:44:multiop.0 00000100:00100000:0.0:1782728025.329984:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d55c3689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:11951:x1869325552086400:12345-192.168.202.31@tcp:44:multiop.0 Request processed in 325us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728025.329993:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 52 00000100:00080000:2.0:1782728025.330069:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782728025.357641:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728025.358065:0:8323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552086528 00000100:00100000:0.0:1782728025.358074:0:8323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552086528 00000100:00100000:0.0:1782728025.358192:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 25 00000100:00100000:0.0:1782728025.358202:0:8323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56ff6ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:2354:x1869325552086528:12345-192.168.202.31@tcp:16:multiop.0 00000100:00100000:3.0:1782728025.475491:0:8323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56ff6ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:2354:x1869325552086528:12345-192.168.202.31@tcp:16:multiop.0 Request processed in 117280us (117850us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728025.475526:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 25 00000001:00080000:1.0:1782728025.477082:0:6630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1782728025.477102:0:6630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000100:00100000:3.0:1782728025.491754:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728025.492032:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552086784 00000100:00100000:0.0:1782728025.492041:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552086784 00000100:00100000:0.0:1782728025.492095:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 11 00000100:00100000:0.0:1782728025.492105:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d55c368b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:11951:x1869325552086784:12345-192.168.202.31@tcp:35:multiop.0 00000001:00080000:0.0:1782728025.492459:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1782728025.492647:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d55c368b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+9:11951:x1869325552086784:12345-192.168.202.31@tcp:35:multiop.0 Request processed in 543us (900us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1782728025.492656:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 11 00000020:00080000:0.0:1782728025.492660:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1782728025.676989:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782728025.679157:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552086912 00000100:00100000:2.0:1782728025.679173:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552086912 00000100:00100000:2.0:1782728025.679250:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 53 00000100:00100000:2.0:1782728025.679260:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+9:12005:x1869325552086912:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:2.0:1782728025.679286:0:7031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782728025.679312:0:7031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c296151e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20b32 expref: -99 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728025.679393:0:7031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c296151eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728025.679408:0:7031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c296151eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728025.679419:0:7031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c296151eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782728025.679888:0:7031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782728025.679894:0:7031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1782728025.679978:0:7031:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c296151eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728025.680005:0:7031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce400/0x22171c6c296151e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b32 expref: 11 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728025.680033:0:7031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c296151eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b32 expref: 10 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728025.680042:0:7031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c9dbb300) 00010000:00010000:2.0:1782728025.680051:0:7031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782728025.680054:0:7031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3cf400, rc 0) 00000100:00100000:2.0:1782728025.680128:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+10:12005:x1869325552086912:12345-192.168.202.31@tcp:101:rm.0 Request processed in 870us (3148us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728025.680136:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 53 00000100:00100000:3.0:1782728025.699955:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728025.700235:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552087168 00000100:00100000:1.0:1782728025.700247:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552087168 00000100:00100000:1.0:1782728025.700354:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 54 00000100:00100000:1.0:1782728025.700365:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d55c368a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+10:12005:x1869325552087168:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:1.0:1782728025.700436:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782728025.700466:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1000/0x22171c6c296151c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b24 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.700489:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d56d03b0600) 00010000:00010000:1.0:1782728025.700567:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c296151eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b32 expref: 9 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.700577:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c9dbb300) 00010000:00010000:1.0:1782728025.700584:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782728025.700606:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1200/0x22171c6c296151f2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.700619:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1200/0x22171c6c296151f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.700628:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1200/0x22171c6c296151f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.700641:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0e00/0x22171c6c296151f9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.700647:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0e00/0x22171c6c296151f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.700667:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0e00/0x22171c6c296151f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.702820:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c29615200 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.702901:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c29615200 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.702963:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c29615200 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782728025.708663:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1782728025.708679:0:5808:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 349662169279ns, next at 350662165768ns, rc = 0 00010000:00010000:1.0:1782728025.708754:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1800/0x22171c6c29615207 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.708771:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1800/0x22171c6c29615207 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.708782:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1800/0x22171c6c29615207 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.708791:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1800/0x22171c6c29615207 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.708797:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1800/0x22171c6c29615207 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.708803:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1800/0x22171c6c29615207 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.708836:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782728025.708862:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c29615200 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.708868:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c29615200 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.708874:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c29615200 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.708879:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f94b0600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1782728025.708884:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c29615200 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.708891:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c29615200 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.708902:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d56d03b0c00) 00010000:00010000:1.0:1782728025.708905:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782728025.708911:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c29615200 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.708917:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c29615200 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.708937:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1200/0x22171c6c296151f2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.708943:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1200/0x22171c6c296151f2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.708948:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1200/0x22171c6c296151f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.708958:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f94b1200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1782728025.708961:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1200/0x22171c6c296151f2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.708967:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1200/0x22171c6c296151f2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.708976:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d03b0e00) 00010000:00010000:1.0:1782728025.708978:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782728025.708981:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1200/0x22171c6c296151f2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728025.708986:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1200/0x22171c6c296151f2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782728025.709002:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000049a1c3dd reply state 000000004b53f4b5 transno 4294967326 ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0e00/0x22171c6c296151f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782728025.709012:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782728025.709120:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d55c368a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+10:12005:x1869325552087168:12345-192.168.202.31@tcp:36:rm.0 Request processed in 8754us (9172us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1782728025.709129:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 54 00010000:00010000:0.0:1782728025.709497:0:8304:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782728025.709505:0:8304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1800/0x22171c6c29615207 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728025.709525:0:8304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f94b1800 already unused, calling callback (ffffffffc152fcf0) 00010000:00010000:0.0:1782728025.709529:0:8304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1800/0x22171c6c29615207 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728025.709536:0:8304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1800/0x22171c6c29615207 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728025.709546:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d56d03b0c00) 00010000:00010000:0.0:1782728025.709549:0:8304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782728025.709552:0:8304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1800/0x22171c6c29615207 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728025.709558:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1800/0x22171c6c29615207 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728025.709573:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782728025.709574:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782728025.709576:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782728025.722674:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0e00/0x22171c6c296151f9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728025.722701:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0e00/0x22171c6c296151f9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728025.722709:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0e00/0x22171c6c296151f9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728025.722715:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f94b0e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1782728025.722721:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0e00/0x22171c6c296151f9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728025.722730:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0e00/0x22171c6c296151f9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728025.722747:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x11a4e1a9 (ffff8d56d03b0000) 00010000:00010000:3.0:1782728025.722750:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782728025.722755:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0e00/0x22171c6c296151f9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728025.722761:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0e00/0x22171c6c296151f9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x11a4e1a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782728025.860040:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:1.0:1782728026.095699:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782728026.734059:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869325572041472:0@lo:400:kworker.0 00000100:00100000:2.0:1782728026.734135:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782728026.734208:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782728026.734214:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869325572041344:0@lo:400:kworker.0 00000100:00100000:2.0:1782728026.734236:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782728026.734250:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f95adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572041856:0@lo:400:kworker.0 00000100:00100000:2.0:1782728026.734274:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782728026.734307:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572041472 00000100:00100000:2.0:1782728026.734314:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572041472 00000100:00100000:2.0:1782728026.734362:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572041344 00000100:00100000:2.0:1782728026.734366:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572041344 00000100:00100000:2.0:1782728026.734386:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1782728026.734394:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f95af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869325572041472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782728026.734414:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3315:1869325572041216:0@lo:400:kworker.0 00000100:00100000:2.0:1782728026.734443:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f95af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869325572041472:12345-0@lo:400:kworker.0 Request processed in 50us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728026.734444:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782728026.734450:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1782728026.734465:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1782728026.734471:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f95ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869325572041344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782728026.734477:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869325572041728:0@lo:400:kworker.0 00000100:00100000:2.0:1782728026.734496:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f95ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869325572041344:12345-0@lo:400:kworker.0 Request processed in 25us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728026.734496:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782728026.734501:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1782728026.734525:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782728026.734530:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572041600:0@lo:400:kworker.0 00000100:00100000:2.0:1782728026.734533:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572041728 00000100:00100000:2.0:1782728026.734535:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572041728 00000100:00100000:0.0:1782728026.734552:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728026.734576:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572041856 00000100:00100000:0.0:1782728026.734579:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572041856 00000100:00100000:0.0:1782728026.734604:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572041600 00000100:00100000:0.0:1782728026.734606:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572041600 00000100:00100000:0.0:1782728026.734623:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782728026.734629:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f95ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572041856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782728026.734658:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f95ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572041856:12345-0@lo:400:kworker.0 Request processed in 30us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728026.734664:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782728026.734677:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782728026.734683:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572041600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782728026.734717:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9935180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572041600:12345-0@lo:400:kworker.0 Request processed in 35us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728026.734722:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782728026.734737:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1782728026.734745:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869325572041728:12345-0@lo:400:kworker.0 00000004:00080000:0.0:1782728026.734774:0:6700:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 350688263145ns, next at 351688261014ns, rc = 0 00000100:00100000:3.0:1782728026.734777:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869325572041728:12345-0@lo:400:kworker.0 Request processed in 34us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728026.734782:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1782728026.734795:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572041216 00000100:00100000:0.0:1782728026.734798:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572041216 00000100:00100000:3.0:1782728026.734801:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782728026.734808:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f9936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572041984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782728026.734820:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1782728026.734826:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3315:x1869325572041216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782728026.734832:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728026.734852:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0853050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3315:x1869325572041216:12345-0@lo:400:kworker.0 Request processed in 27us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728026.734858:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1782728026.734868:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572041984 00000100:00100000:3.0:1782728026.734872:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572041984 00000100:00100000:3.0:1782728026.734895:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782728026.734901:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d55c3689f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572041984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782728026.734917:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782728026.734950:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d55c3689f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572041984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728026.734956:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782728026.734989:0:3316:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1782728026.734994:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d56f9935500, transno 4294967304 00000100:00100000:3.0:1782728026.735022:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f9936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572041984:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782728026.735248:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782728026.735252:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782728026.735255:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782728026.735285:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869325572041344:0@lo:400:kworker.0 00000100:00100000:3.0:1782728026.735295:0:3317:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1782728026.735298:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d56f9934a80, transno 4294967301 00000100:00100000:3.0:1782728026.735308:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f95adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572041856:0@lo:400:kworker.0 00000100:00100000:3.0:1782728026.735318:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1869325572041472:0@lo:400:kworker.0 00000100:00100000:3.0:1782728026.735351:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572041600:0@lo:400:kworker.0 00000100:00100000:3.0:1782728026.735360:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3315:1869325572041216:0@lo:400:kworker.0 00000100:00100000:3.0:1782728026.735369:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1869325572041728:0@lo:400:kworker.0 00010000:00010000:0.0:1782728027.118222:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782728027.247127:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782728027.247150:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d55c3689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572042112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782728027.247229:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782728027.247298:0:8059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572042112 00000100:00100000:1.0:1782728027.247306:0:8059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572042112 00000100:00100000:1.0:1782728027.247364:0:8059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782728027.247373:0:8059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572042112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782728027.247419:0:8059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782728027.247486:0:8059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572042112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728027.247493:0:8059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782728027.247860:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d55c3689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572042112:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782728028.142415:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782728028.385581:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728028.385613:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728028.385652:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728028.385684:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728028.385715:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552087552 00000100:00100000:3.0:1782728028.385723:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552087552 00000100:00100000:3.0:1782728028.385776:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552087680 00000100:00100000:3.0:1782728028.385779:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552087680 00000100:00100000:3.0:1782728028.385802:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 60 00000100:00100000:3.0:1782728028.385811:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:2353:x1869325552087552:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782728028.386081:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552087296 00000100:00100000:0.0:1782728028.386086:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552087296 00000100:00100000:0.0:1782728028.386115:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 250 00000100:00100000:0.0:1782728028.386121:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+10:2353:x1869325552087296:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782728028.386172:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0851c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b661aafc-708f-4f38-b71b-eec242d406b4+10:2353:x1869325552087296:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 50us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728028.386179:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 250 00000100:00100000:0.0:1782728028.386227:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 61 00000100:00100000:0.0:1782728028.386234:0:8323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2353:x1869325552087680:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782728028.386261:0:8323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2353:x1869325552087680:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 28us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728028.386267:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 61 00000100:00080000:0.0:1782728028.386298:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782728028.386302:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782728028.386434:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552087424 00000100:00100000:2.0:1782728028.386439:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552087424 00000100:00100000:2.0:1782728028.386485:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 123 00000100:00100000:2.0:1782728028.386492:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+9:2353:x1869325552087424:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782728028.386548:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+9:2353:x1869325552087424:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 57us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728028.386554:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 123 00000100:00100000:3.0:1782728028.387368:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:2353:x1869325552087552:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 1555us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728028.387377:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 60 00000100:00080000:0.0:1782728028.387745:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782728029.166026:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782728029.372403:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:2.0:1782728029.372435:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967325 is committed 00000001:00080000:2.0:1782728029.372450:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967326 is committed 00000004:00080000:2.0:1782728029.372452:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:0.0:1782728029.372526:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782728029.372546:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f9934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572042240:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782728029.372617:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782728029.372673:0:8323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572042240 00000100:00100000:3.0:1782728029.372681:0:8323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572042240 00000100:00100000:3.0:1782728029.372749:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1782728029.372750:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782728029.372758:0:8323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572042240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1782728029.372788:0:8323:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1782728029.372815:0:8323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfb92ef2/0x22171c6c2961520e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728029.372834:0:8323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000091f3bc2d/0x22171c6c296151cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b2b expref: 6 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728029.372843:0:8323:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=9s v=(0 0) 00010000:00010000:3.0:1782728029.372847:0:8323:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782728029.372864:0:8323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfb92ef2/0x22171c6c2961520e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728029.372892:0:8323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000091f3bc2d/0x22171c6c296151cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b2b expref: 6 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728029.372905:0:8323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000091f3bc2d/0x22171c6c296151cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b2b expref: 6 pid: 6606 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782728029.372917:0:8323:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8323:1869325572042368:192.168.202.31@tcp:104: 00000100:00100000:3.0:1782728029.373000:0:8323:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d5700f1a000 going to sleep for 11 seconds 00000100:00100000:0.0:1782728029.387758:0:8323:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8323:1869325572042368:192.168.202.31@tcp:104: 00010000:00010000:0.0:1782728029.387790:0:8323:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cfb92ef2/0x22171c6c2961520e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782728029.394038:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782728029.394391:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552087808 00000100:00100000:2.0:1782728029.394400:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552087808 00010000:00010000:2.0:1782728029.394441:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000091f3bc2d/0x22171c6c296151cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b2b expref: 7 pid: 6606 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782728029.394480:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 33 00000100:00100000:2.0:1782728029.394490:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c9951f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:2354:x1869325552087808:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782728029.394505:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782728029.394536:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000091f3bc2d/0x22171c6c296151cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b2b expref: 7 pid: 6606 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728029.394548:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000091f3bc2d/0x22171c6c296151cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b2b expref: 7 pid: 6606 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728029.394571:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091f3bc2d/0x22171c6c296151cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b2b expref: 7 pid: 6606 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728029.394599:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782728029.394602:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782728029.394608:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cfb92ef2/0x22171c6c2961520e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728029.394617:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfb92ef2/0x22171c6c2961520e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728029.394645:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782728029.394695:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c9951f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2354:x1869325552087808:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 206us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728029.394702:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 33 00010000:00010000:1.0:1782728029.394764:0:8323:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cfb92ef2/0x22171c6c2961520e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728029.394773:0:8323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfb92ef2/0x22171c6c2961520e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728029.394783:0:8323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfb92ef2/0x22171c6c2961520e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728029.394791:0:8323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfb92ef2/0x22171c6c2961520e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728029.394813:0:8323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782728029.394966:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782728029.394972:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfb92ef2/0x22171c6c2961520e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728029.394980:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f44f0e00 already unused, calling callback (ffffffffc152fcf0) 00010000:00010000:0.0:1782728029.394993:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfb92ef2/0x22171c6c2961520e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728029.395002:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfb92ef2/0x22171c6c2961520e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728029.395015:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfb92ef2/0x22171c6c2961520e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728029.395022:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfb92ef2/0x22171c6c2961520e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728029.395041:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782728029.395043:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782728029.395045:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782728029.396681:0:8323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9935500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1869325572042240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23920us (24060us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1782728029.396692:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:0.0:1782728029.396718:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d56f9934a80/2, rc 0, transno 4294967306 00000100:00100000:0.0:1782728029.396724:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f9934a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572042240:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1782728030.199093:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782728030.956246:0:6630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00010000:00010000:0.0:1782728031.215177:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782728031.858563:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782728031.858584:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f9936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572042496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782728031.858991:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782728031.859119:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572042496 00000100:00100000:1.0:1782728031.859128:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572042496 00000100:00100000:1.0:1782728031.859194:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782728031.859205:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d55c3689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572042496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782728031.859242:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782728031.859294:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d55c3689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572042496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728031.859314:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782728031.859357:0:3317:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1782728031.859363:0:3317:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d56f9934a80, transno 4294967306 00000100:00100000:1.0:1782728031.859380:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f9936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572042496:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782728031.859928:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782728031.872366:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f9ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869325572042752:0@lo:400:kworker.0 00000100:00100000:0.0:1782728031.872445:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728031.872542:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f9ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869325572042880:0@lo:400:kworker.0 00000100:00100000:0.0:1782728031.872566:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728031.876568:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d9f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869325572043008:0@lo:400:kworker.0 00000100:00100000:0.0:1782728031.876652:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728031.876707:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782728031.876714:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f9ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572042624:0@lo:400:kworker.0 00000100:00100000:0.0:1782728031.876744:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728031.876765:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572043136:0@lo:400:kworker.0 00000100:00100000:0.0:1782728031.876791:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728031.876838:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572042624 00000100:00100000:0.0:1782728031.876845:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572042624 00000100:00100000:0.0:1782728031.876885:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1782728031.876893:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3316:x1869325572042624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782728031.876941:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0852050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3316:x1869325572042624:12345-0@lo:400:kworker.0 Request processed in 48us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728031.876948:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1782728031.877012:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f9ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3316:1869325572042624:0@lo:400:kworker.0 00000100:00100000:2.0:1782728031.877203:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572042752 00000100:00100000:2.0:1782728031.877209:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572042752 00000100:00100000:2.0:1782728031.877237:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572042880 00000100:00100000:2.0:1782728031.877240:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572042880 00000100:00100000:2.0:1782728031.877265:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572043008 00000100:00100000:2.0:1782728031.877267:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572043008 00000100:00100000:2.0:1782728031.877281:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1782728031.877288:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869325572042752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782728031.877331:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869325572042752:12345-0@lo:400:kworker.0 Request processed in 44us (4887us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728031.877337:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1782728031.877350:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1782728031.877357:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869325572042880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782728031.877388:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869325572042880:12345-0@lo:400:kworker.0 Request processed in 32us (4821us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728031.877400:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1782728031.877411:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1782728031.877416:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f997a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869325572043008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782728031.877449:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f997a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869325572043008:12345-0@lo:400:kworker.0 Request processed in 33us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728031.877455:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1782728031.877489:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f9ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869325572042752:0@lo:400:kworker.0 00000100:00100000:2.0:1782728031.877530:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f9ac1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1869325572042880:0@lo:400:kworker.0 00000100:00100000:2.0:1782728031.877551:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d9f5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1869325572043008:0@lo:400:kworker.0 00000100:00080000:2.0:1782728031.877564:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782728031.877768:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572043136 00000100:00100000:1.0:1782728031.877773:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572043136 00000100:00100000:1.0:1782728031.877817:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782728031.877824:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572043136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782728031.877863:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572043136:12345-0@lo:400:kworker.0 Request processed in 39us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728031.877869:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782728031.877898:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5c38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572043136:0@lo:400:kworker.0 00000100:00080000:2.0:1782728031.879348:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782728032.237730:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782728032.370464:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782728032.370488:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56d09aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572043264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782728032.370594:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782728032.370731:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572043264 00000100:00100000:3.0:1782728032.370739:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572043264 00000100:00100000:3.0:1782728032.370790:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782728032.370799:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572043264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782728032.370833:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782728032.370886:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572043264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728032.370893:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782728032.371041:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56d09aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572043264:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782728033.261880:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782728033.505776:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728033.505901:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552087936 00000100:00100000:3.0:1782728033.505914:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552087936 00000100:00100000:3.0:1782728033.507660:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 252 00000100:00100000:3.0:1782728033.507691:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2353:x1869325552087936:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782728033.507810:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0852c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2353:x1869325552087936:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 136us (2051us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728033.507819:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 252 00000100:00100000:1.0:1782728033.508011:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728033.508188:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728033.508216:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728033.508249:0:8323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552088320 00000100:00100000:1.0:1782728033.508258:0:8323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552088320 00000100:00100000:1.0:1782728033.508309:0:8323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552088192 00000100:00100000:1.0:1782728033.508312:0:8323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552088192 00000100:00100000:1.0:1782728033.508333:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 63 00000100:00100000:1.0:1782728033.508341:0:8323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c9953800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2352:x1869325552088320:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782728033.508386:0:8323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c9953800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:2352:x1869325552088320:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 45us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728033.508393:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 63 00000100:00100000:1.0:1782728033.508407:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 64 00000100:00100000:1.0:1782728033.508421:0:8323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c9950700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2353:x1869325552088192:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782728033.508451:0:8323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c9950700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2353:x1869325552088192:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 31us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728033.508457:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 64 00000100:00100000:2.0:1782728033.513389:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552088064 00000100:00100000:2.0:1782728033.513409:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552088064 00000100:00100000:2.0:1782728033.513504:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 127 00000100:00100000:2.0:1782728033.513531:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c9953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2352:x1869325552088064:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782728033.513654:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c9953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2352:x1869325552088064:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 126us (5643us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728033.513663:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 127 00000100:00080000:2.0:1782728033.513697:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782728033.513703:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782728033.513707:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:3.0:1782728033.852928:0:12349:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 118d: Fsync validation inject a delay of the bulk ==================================================================== 06:13:52 (1782728032) 00010000:00010000:0.0:1782728034.286192:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782728034.661305:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782728034.661609:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552088448 00000100:00100000:2.0:1782728034.661623:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552088448 00000100:00100000:2.0:1782728034.661710:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 55 00000100:00100000:2.0:1782728034.661740:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c9952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:12637:x1869325552088448:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782728034.661769:0:7031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782728034.661801:0:7031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29615215 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20b39 expref: -99 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728034.661878:0:7031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c2961521c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728034.661895:0:7031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c2961521c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728034.661907:0:7031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c2961521c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782728034.662199:0:7031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782728034.662204:0:7031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1782728034.662869:0:7031:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c2961521c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.662913:0:7031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cee00/0x22171c6c29615215 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b39 expref: 8 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.662936:0:7031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c2961521c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b39 expref: 7 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.662958:0:7031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c9dbbb00) 00010000:00010000:3.0:1782728034.662961:0:7031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782728034.662965:0:7031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3cf400, rc 0) 00000100:00100000:3.0:1782728034.663055:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c9952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:12637:x1869325552088448:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 1317us (1764us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728034.663064:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 55 00000100:00100000:2.0:1782728034.672822:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728034.672957:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552088704 00000100:00100000:1.0:1782728034.672972:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552088704 00000100:00100000:1.0:1782728034.673045:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 56 00000100:00100000:1.0:1782728034.673057:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f95aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:12637:x1869325552088704:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782728034.673085:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782728034.673089:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782728034.673123:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf400/0x22171c6c2961521c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b39 expref: 7 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.673149:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c9dbbb00) 00010000:00010000:1.0:1782728034.673172:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782728034.673193:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1200/0x22171c6c29615223 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20b40 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.673910:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c2961522a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.673927:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c2961522a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.673950:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c2961522a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.673964:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1000/0x22171c6c29615231 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.673981:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1000/0x22171c6c29615231 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.673988:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1000/0x22171c6c29615231 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.678040:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c29615238 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.678069:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c29615238 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.678084:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c29615238 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782728034.678098:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x8:0x0]: returning size 0 00010000:00010000:1.0:1782728034.678133:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c2961522a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.678142:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c2961522a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.678150:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c2961522a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.678169:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f94b0600 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:1.0:1782728034.678174:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c2961522a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.678182:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c2961522a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.678213:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d03b0900) 00010000:00010000:1.0:1782728034.678216:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782728034.678221:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c2961522a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.678237:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0600/0x22171c6c2961522a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782728034.678255:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000038e4bec5 reply state 00000000be59d3c1 transno 4294967327 ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1000/0x22171c6c29615231 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782728034.678266:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782728034.678312:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1200/0x22171c6c29615223 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b40 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.678337:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c29615238 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b40 expref: 8 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.678345:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8d56d03b0300) 00010000:00010000:1.0:1782728034.678348:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782728034.678351:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f94b0200, rc 0) 00000100:00100000:1.0:1782728034.678484:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f95aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+9:12637:x1869325552088704:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 5427us (5675us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1782728034.678496:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 56 00010000:00010000:0.0:1782728034.686061:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1000/0x22171c6c29615231 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.686087:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1000/0x22171c6c29615231 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.686096:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1000/0x22171c6c29615231 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.686105:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f94b1000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1782728034.686111:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1000/0x22171c6c29615231 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.686119:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1000/0x22171c6c29615231 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.686140:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff8d56d03b0d00) 00010000:00010000:0.0:1782728034.686143:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782728034.686149:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1000/0x22171c6c29615231 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.686163:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1000/0x22171c6c29615231 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782728034.701763:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728034.704068:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552088960 00000100:00100000:0.0:1782728034.704091:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552088960 00000100:00100000:0.0:1782728034.704205:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 57 00000100:00100000:0.0:1782728034.704250:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f95adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:12637:x1869325552088960:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1782728034.704287:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782728034.704321:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6800/0x22171c6c29615246 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20b47 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.704465:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6a00/0x22171c6c2961524d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.704484:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c29615238 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b40 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.704494:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6a00/0x22171c6c2961524d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.704671:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c29615238 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b40 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.704688:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c29615238 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b40 expref: 9 pid: 5808 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782728034.704705:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f9979f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1869325572043392:192.168.202.31@tcp:104: 00000100:00100000:0.0:1782728034.704863:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d086c600 going to sleep for 11 seconds 00000100:00100000:2.0:1782728034.711867:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728034.711997:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552089088 00000100:00100000:1.0:1782728034.712009:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552089088 00010000:00010000:1.0:1782728034.712065:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c29615238 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b40 expref: 10 pid: 5808 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782728034.712145:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 34 00000100:00100000:1.0:1782728034.712168:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d9f5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+10:2353:x1869325552089088:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782728034.712189:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782728034.712197:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c29615238 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b40 expref: 10 pid: 5808 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.712213:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c29615238 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b40 expref: 10 pid: 5808 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.712253:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8d56d03b0300) 00010000:00010000:1.0:1782728034.712259:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6a00/0x22171c6c2961524d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.712271:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6a00/0x22171c6c2961524d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.712279:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6a00/0x22171c6c2961524d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.712302:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782728034.712378:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d9f5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+10:2353:x1869325552089088:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 222us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728034.712387:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 34 00010000:00010000:0.0:1782728034.713336:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c29615238 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b40 expref: 9 pid: 5808 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782728034.713363:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f9979f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1869325572043392:192.168.202.31@tcp:104: 00010000:00010000:0.0:1782728034.713390:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6a00/0x22171c6c2961524d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.713418:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6a00/0x22171c6c2961524d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.713424:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6a00/0x22171c6c2961524d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782728034.713450:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x8:0x0]: returning size 0 00000004:00080000:0.0:1782728034.714131:0:5807:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00000004:00080000:0.0:1782728034.714144:0:5807:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1782728034.714346:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6a00/0x22171c6c2961524d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.714356:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6a00/0x22171c6c2961524d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.714364:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6a00/0x22171c6c2961524d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.714371:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f9af6a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1782728034.714377:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6a00/0x22171c6c2961524d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.714386:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6a00/0x22171c6c2961524d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.714405:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8d56d03b0300) 00010000:00010000:0.0:1782728034.714408:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782728034.714412:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6a00/0x22171c6c2961524d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.714418:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6a00/0x22171c6c2961524d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.714550:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6800/0x22171c6c29615246 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b47 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.715304:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d830b900) 00010000:00010000:0.0:1782728034.715309:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782728034.715317:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6800/0x22171c6c29615246 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b47 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.715339:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f9af6800, rc 0) 00000100:00100000:0.0:1782728034.715444:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f95adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:12637:x1869325552088960:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 11199us (13695us total) trans 4294967328 rc 301/301 00000100:00100000:0.0:1782728034.715454:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 57 00000100:00100000:2.0:1782728034.724199:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728034.724417:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552089344 00000100:00100000:0.0:1782728034.724432:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552089344 00000100:00100000:0.0:1782728034.724683:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 12 00000100:00100000:0.0:1782728034.724699:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f44a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:12637:x1869325552089344:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:0.0:1782728034.726136:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f44a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+9:12637:x1869325552089344:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 1431us (1941us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1782728034.726149:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 12 00000100:00100000:1.0:1782728034.730136:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728034.730446:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552089472 00000100:00100000:3.0:1782728034.730460:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552089472 00000100:00100000:2.0:1782728034.730697:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 58 00000100:00100000:2.0:1782728034.730714:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c9951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+9:12637:x1869325552089472:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782728034.730746:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782728034.730781:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c2961525b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20b4e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728034.730860:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c2961525b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b4e expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728034.731028:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c2961525b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b4e expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728034.731055:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8d56c9dbbc00) 00010000:00010000:2.0:1782728034.731059:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782728034.731063:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3ce600, rc 0) 00000100:00100000:2.0:1782728034.731355:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c9951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+10:12637:x1869325552089472:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 644us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728034.731364:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 58 00000100:00100000:2.0:1782728034.736322:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728034.736690:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552089728 00000100:00100000:0.0:1782728034.736706:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552089728 00000100:00100000:0.0:1782728034.736815:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 13 00000100:00100000:0.0:1782728034.736828:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f44a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+10:12637:x1869325552089728:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:0.0:1782728034.737240:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f44a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+11:12637:x1869325552089728:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 405us (922us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1782728034.737269:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 13 00000100:00100000:1.0:1782728034.749986:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782728034.750083:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552089856 00000100:00100000:2.0:1782728034.750096:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552089856 00000100:00100000:2.0:1782728034.750182:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 59 00000100:00100000:2.0:1782728034.750193:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c9950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+11:12638:x1869325552089856:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:2.0:1782728034.750225:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782728034.750268:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29615262 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20b55 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728034.750356:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29615269 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728034.750374:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29615269 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728034.750399:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29615269 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782728034.750504:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782728034.750542:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1782728034.750575:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29615269 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728034.750606:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29615262 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b55 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728034.750627:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29615269 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b55 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728034.750637:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c9dbb500) 00010000:00010000:2.0:1782728034.750641:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782728034.750645:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3cf000, rc 0) 00000100:00100000:2.0:1782728034.750783:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c9950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+12:12638:x1869325552089856:12345-192.168.202.31@tcp:101:dd.0 Request processed in 592us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728034.750792:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 59 00000100:00100000:1.0:1782728034.762017:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728034.762127:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552090112 00000100:00100000:0.0:1782728034.762139:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552090112 00000100:00100000:0.0:1782728034.762213:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 60 00000100:00100000:0.0:1782728034.762224:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c9953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+12:12638:x1869325552090112:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1782728034.762250:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782728034.762254:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782728034.762288:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf000/0x22171c6c29615269 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b55 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.762313:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c9dbb500) 00010000:00010000:0.0:1782728034.762325:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782728034.762344:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6800/0x22171c6c29615270 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20b5c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.762814:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6a00/0x22171c6c29615277 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.762830:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6a00/0x22171c6c29615277 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.762841:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6a00/0x22171c6c29615277 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.762855:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7800/0x22171c6c2961527e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.762862:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7800/0x22171c6c2961527e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.762890:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7800/0x22171c6c2961527e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.762990:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7600/0x22171c6c29615285 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.762999:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7600/0x22171c6c29615285 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.763006:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7600/0x22171c6c29615285 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782728034.763018:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x8:0x0]: returning size 0 00010000:00010000:0.0:1782728034.763144:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6a00/0x22171c6c29615277 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.763153:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6a00/0x22171c6c29615277 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.763161:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6a00/0x22171c6c29615277 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.763167:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f9af6a00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1782728034.763172:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6a00/0x22171c6c29615277 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.763181:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6a00/0x22171c6c29615277 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.763192:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d830b900) 00010000:00010000:0.0:1782728034.763195:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782728034.763207:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6a00/0x22171c6c29615277 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.763213:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6a00/0x22171c6c29615277 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.763226:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7800/0x22171c6c2961527e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.763233:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7800/0x22171c6c2961527e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.763238:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7800/0x22171c6c2961527e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.763244:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f9af7800 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1782728034.763247:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7800/0x22171c6c2961527e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.763253:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7800/0x22171c6c2961527e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.763261:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff8d56d830be00) 00010000:00010000:0.0:1782728034.763264:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782728034.763266:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7800/0x22171c6c2961527e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.763273:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7800/0x22171c6c2961527e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.763322:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6800/0x22171c6c29615270 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b5c expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.763352:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7600/0x22171c6c29615285 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b5c expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.763360:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8d56c9dbbc00) 00010000:00010000:0.0:1782728034.763363:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782728034.763365:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f9af7600, rc 0) 00000100:00100000:0.0:1782728034.763452:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c9953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+13:12638:x1869325552090112:12345-192.168.202.31@tcp:101:dd.0 Request processed in 1230us (1448us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1782728034.763459:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 60 00000100:00100000:3.0:1782728034.779033:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782728034.779693:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552090368 00000100:00100000:2.0:1782728034.779708:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552090368 00000100:00100000:2.0:1782728034.779793:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 61 00000100:00100000:2.0:1782728034.779804:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d09aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+13:12638:x1869325552090368:12345-192.168.202.31@tcp:36:dd.0 00010000:00010000:2.0:1782728034.779895:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782728034.779931:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7600/0x22171c6c29615285 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b5c expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728034.779970:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8d56c9dbbc00) 00010000:00010000:2.0:1782728034.779976:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782728034.780306:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29615293 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728034.780323:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29615293 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728034.780334:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29615293 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782728034.780396:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967332 00000004:00010000:2.0:1782728034.780419:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000057b802f5 reply state 00000000b0e66301 transno 4294967333 ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29615293 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782728034.780428:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782728034.781015:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d09aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+15:12638:x1869325552090368:12345-192.168.202.31@tcp:36:dd.0 Request processed in 1209us (1993us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1782728034.781025:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 61 00000020:00080000:2.0:1782728034.781032:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782728034.783931:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29615293 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.783966:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29615293 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.783974:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29615293 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.783981:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56dd3cf200 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1782728034.783987:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29615293 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.784014:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29615293 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.784036:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8d56c9dbbc00) 00010000:00010000:3.0:1782728034.784040:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782728034.784045:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29615293 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.784052:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3cf200/0x22171c6c29615293 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782728034.788997:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728034.789431:0:8323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552090496 00000100:00100000:1.0:1782728034.789454:0:8323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552090496 00000100:00100000:1.0:1782728034.789563:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 27 00000100:00100000:1.0:1782728034.789576:0:8323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f996ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+5:12638:x1869325552090496:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1782728034.789600:0:8323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782728034.789628:0:8323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091f3bc2d/0x22171c6c2961529a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20b63 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782728034.789666:0:8323:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782728034.789696:0:8323:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=358s v=(0 0) 00010000:00010000:1.0:1782728034.789702:0:8323:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782728034.789712:0:8323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091f3bc2d/0x22171c6c2961529a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b63 expref: 6 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.789735:0:8323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000091f3bc2d/0x22171c6c2961529a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b63 expref: 6 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.789751:0:8323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f94b1400, rc 0) 00000100:00100000:1.0:1782728034.789820:0:8323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f996ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:12638:x1869325552090496:12345-192.168.202.31@tcp:101:dd.0 Request processed in 247us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728034.789828:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 27 00000100:00100000:1.0:1782728034.794073:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782728034.794356:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552090624 00000100:00100000:2.0:1782728034.794369:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552090624 00000100:00100000:2.0:1782728034.794448:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 28 00000100:00100000:2.0:1782728034.794459:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c9950380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:12638:x1869325552090624:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:2.0:1782728034.794482:0:6607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782728034.794654:0:6607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000353d0a84/0x22171c6c296152a1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20b6a expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782728034.794692:0:6607:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782728034.794721:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=358s v=(0 0) 00010000:00010000:2.0:1782728034.794726:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782728034.794735:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000353d0a84/0x22171c6c296152a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b6a expref: 7 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728034.794779:0:6607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000353d0a84/0x22171c6c296152a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b6a expref: 7 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728034.794794:0:6607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56dd3cf200, rc 0) 00000100:00100000:2.0:1782728034.794868:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c9950380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:12638:x1869325552090624:12345-192.168.202.31@tcp:101:dd.0 Request processed in 411us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728034.794876:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 28 00000100:00100000:3.0:1782728034.798627:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728034.798704:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552090752 00000100:00100000:0.0:1782728034.798717:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552090752 00002000:00010000:0.0:1782728034.798773:0:6610:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/4 (0->18446744073709551615) 00002000:00100000:0.0:1782728034.798779:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d56f9969500 with x1869325552090752 ext(0->18446744073709551615) 00002000:00010000:0.0:1782728034.798795:0:6610:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d56f9969500. 00000100:00100000:0.0:1782728034.798837:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 7 00000100:00100000:0.0:1782728034.798847:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9969500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:2352:x1869325552090752:12345-192.168.202.31@tcp:10:dd.0 00002000:00010000:0.0:1782728034.799284:0:6610:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1782728034.799288:0:6610:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1782728035 00002000:00010000:0.0:1782728034.799291:0:6610:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1782728034.799292:0:6610:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1782728035 00002000:00010000:0.0:1782728034.799294:0:6610:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1782728034.799385:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9969500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:2352:x1869325552090752:12345-192.168.202.31@tcp:10:dd.0 Request processed in 538us (772us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1782728034.799394:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 7 00002000:00010000:0.0:1782728034.799399:0:6610:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/4 (0->18446744073709551615) 00002000:00100000:0.0:1782728034.799419:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d56f9969500 with x1869325552090752 ext(0->18446744073709551615) 00002000:00010000:0.0:1782728034.799425:0:6610:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d56f9969500. 00000100:00100000:0.0:1782728034.800772:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782728034.800863:0:6612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552090880 00000100:00100000:2.0:1782728034.800872:0:6612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552090880 00002000:00010000:2.0:1782728034.800927:0:6612:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (0->18446744073709551615) 00002000:00100000:2.0:1782728034.800933:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d56f9979f80 with x1869325552090880 ext(0->18446744073709551615) 00002000:00010000:2.0:1782728034.800952:0:6612:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d56f9979f80. 00000100:00100000:2.0:1782728034.800984:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 8 00000100:00100000:2.0:1782728034.800993:0:6612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:2352:x1869325552090880:12345-192.168.202.31@tcp:10:dd.0 00002000:00010000:2.0:1782728034.801459:0:6612:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782728034.801464:0:6612:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1782728035 00002000:00010000:2.0:1782728034.801466:0:6612:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1782728034.801469:0:6612:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 0 -> 1782728035 00002000:00010000:2.0:1782728034.801471:0:6612:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782728034.801724:0:6612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:2352:x1869325552090880:12345-192.168.202.31@tcp:10:dd.0 Request processed in 730us (959us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1782728034.801731:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 8 00002000:00010000:2.0:1782728034.801735:0:6612:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/6 (0->18446744073709551615) 00002000:00100000:2.0:1782728034.801738:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d56f9979f80 with x1869325552090880 ext(0->18446744073709551615) 00002000:00010000:2.0:1782728034.801758:0:6612:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8d56f9979f80. 00000100:00100000:2.0:1782728034.817718:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728034.818062:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552091008 00000100:00100000:1.0:1782728034.818075:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552091008 00002000:00100000:1.0:1782728034.818141:0:6611:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->65535) req@ffff8d56f44a4700 x1869325552091008/t0(0) o4->f9926b93-a1e5-4dad-ade1-7cd7c966fac6@192.168.202.31@tcp:150/0 lens 488/0 e 0 to 0 dl 1782728045 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782728034.818153:0:6611:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d56f44a4700 with x1869325552091008 ext(0->65535) 00002000:00010000:1.0:1782728034.818177:0:6611:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d56f44a4700 00000100:00100000:1.0:1782728034.818267:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 9 00000100:00100000:1.0:1782728034.818278:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f44a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:2352:x1869325552091008:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1782728034.825298:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f44a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+9:2352:x1869325552091008:12345-192.168.202.31@tcp:4:dd.0 Request processed in 7008us (7580us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1782728034.825310:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 9 00002000:00100000:2.0:1782728034.825323:0:6611:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->65535) req@ffff8d56f44a4700 x1869325552091008/t4294967303(0) o4->f9926b93-a1e5-4dad-ade1-7cd7c966fac6@192.168.202.31@tcp:150/0 lens 488/448 e 0 to 0 dl 1782728045 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782728034.825332:0:6611:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d56f44a4700 with x1869325552091008 ext(0->65535) 00002000:00010000:2.0:1782728034.825339:0:6611:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d56f44a4700 00000100:00100000:2.0:1782728034.830298:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728034.830435:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552091264 00000100:00100000:0.0:1782728034.830447:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552091264 00000100:00100000:0.0:1782728034.830815:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 14 00000100:00100000:0.0:1782728034.830826:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+14:12638:x1869325552091264:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:0.0:1782728034.831308:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f55e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+15:12638:x1869325552091264:12345-192.168.202.31@tcp:35:dd.0 Request processed in 482us (1026us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1782728034.831318:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 14 00000100:00100000:0.0:1782728034.847464:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782728034.848039:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552091392 00000100:00100000:2.0:1782728034.848053:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552091392 00002000:00100000:2.0:1782728034.848123:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (65536->131071) req@ffff8d56f997b100 x1869325552091392/t0(0) o4->f9926b93-a1e5-4dad-ade1-7cd7c966fac6@192.168.202.31@tcp:150/0 lens 488/0 e 0 to 0 dl 1782728045 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782728034.848136:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d56f997b100 with x1869325552091392 ext(65536->131071) 00002000:00010000:2.0:1782728034.848143:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d56f997b100 00000100:00100000:2.0:1782728034.848315:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 10 00000100:00100000:2.0:1782728034.848327:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f997b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+9:2355:x1869325552091392:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1782728034.855298:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f997b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+11:2355:x1869325552091392:12345-192.168.202.31@tcp:4:dd.0 Request processed in 6956us (7901us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1782728034.855316:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 10 00002000:00100000:2.0:1782728034.855332:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (65536->131071) req@ffff8d56f997b100 x1869325552091392/t4294967304(0) o4->f9926b93-a1e5-4dad-ade1-7cd7c966fac6@192.168.202.31@tcp:150/0 lens 488/448 e 0 to 0 dl 1782728045 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782728034.855343:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d56f997b100 with x1869325552091392 ext(65536->131071) 00002000:00010000:2.0:1782728034.855356:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d56f997b100 00000100:00100000:0.0:1782728034.896033:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728034.896222:0:10280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552091520 00000100:00100000:1.0:1782728034.896252:0:10280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552091520 00000100:00100000:1.0:1782728034.896340:0:10280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 62 00000100:00100000:1.0:1782728034.896354:0:10280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f997b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+15:12640:x1869325552091520:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:1.0:1782728034.896397:0:10280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782728034.896441:0:10280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c296152a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20b71 expref: -99 pid: 10280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.896574:0:10280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1200/0x22171c6c296152af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.896593:0:10280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1200/0x22171c6c296152af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.896607:0:10280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1200/0x22171c6c296152af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782728034.896693:0:10280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782728034.896698:0:10280:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1782728034.896725:0:10280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1200/0x22171c6c296152af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.896756:0:10280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b0200/0x22171c6c296152a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b71 expref: 17 pid: 10280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.896778:0:10280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1200/0x22171c6c296152af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b71 expref: 16 pid: 10280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728034.896807:0:10280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d03b0300) 00010000:00010000:1.0:1782728034.896810:0:10280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782728034.896814:0:10280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f94b1200, rc 0) 00000100:00100000:1.0:1782728034.896897:0:10280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f997b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+16:12640:x1869325552091520:12345-192.168.202.31@tcp:101:rm.0 Request processed in 546us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728034.896905:0:10280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 62 00000100:00100000:1.0:1782728034.901458:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728034.901693:0:7031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552091648 00000100:00100000:3.0:1782728034.901706:0:7031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552091648 00000100:00100000:3.0:1782728034.901781:0:7031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 63 00000100:00100000:3.0:1782728034.901793:0:7031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c9952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+16:12640:x1869325552091648:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:3.0:1782728034.901821:0:7031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782728034.901848:0:7031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1400/0x22171c6c296152b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20b78 expref: -99 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.901934:0:7031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1000/0x22171c6c296152bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.901961:0:7031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1000/0x22171c6c296152bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.901974:0:7031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1000/0x22171c6c296152bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.902016:0:7031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1e00/0x22171c6c296152c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.902024:0:7031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1e00/0x22171c6c296152c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.902030:0:7031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1e00/0x22171c6c296152c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.902160:0:7031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0600/0x22171c6c296152cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.902170:0:7031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0600/0x22171c6c296152cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.902177:0:7031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0600/0x22171c6c296152cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782728034.902221:0:7031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x8:0x0]: returning size 131072 00000004:00200000:3.0:1782728034.902237:0:7031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782728034.902261:0:7031:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0600/0x22171c6c296152cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.902275:0:7031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0600/0x22171c6c296152cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.902285:0:7031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1000/0x22171c6c296152bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.902292:0:7031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1000/0x22171c6c296152bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.902310:0:7031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1000/0x22171c6c296152bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.902317:0:7031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f44f1000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1782728034.902322:0:7031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1000/0x22171c6c296152bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.902331:0:7031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1000/0x22171c6c296152bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.902346:0:7031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d03b0300) 00010000:00010000:3.0:1782728034.902350:0:7031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782728034.902355:0:7031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1000/0x22171c6c296152bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.902363:0:7031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1000/0x22171c6c296152bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.902379:0:7031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1e00/0x22171c6c296152c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.902387:0:7031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1e00/0x22171c6c296152c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.902392:0:7031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1e00/0x22171c6c296152c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.902398:0:7031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f44f1e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1782728034.902401:0:7031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1e00/0x22171c6c296152c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.902419:0:7031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1e00/0x22171c6c296152c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.902429:0:7031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff8d56c4d03100) 00010000:00010000:3.0:1782728034.902431:0:7031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782728034.902434:0:7031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1e00/0x22171c6c296152c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.902439:0:7031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1e00/0x22171c6c296152c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.902475:0:7031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1400/0x22171c6c296152b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b78 expref: 18 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.902490:0:7031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0600/0x22171c6c296152cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b78 expref: 17 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.902497:0:7031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8d56c9dbbc00) 00010000:00010000:3.0:1782728034.902499:0:7031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782728034.902502:0:7031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f44f0600, rc 0) 00000100:00100000:3.0:1782728034.902650:0:7031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c9952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+17:12640:x1869325552091648:12345-192.168.202.31@tcp:101:rm.0 Request processed in 858us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728034.902659:0:7031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 63 00000100:00100000:2.0:1782728034.935168:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728034.935484:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552091904 00000100:00100000:0.0:1782728034.935496:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552091904 00000100:00100000:0.0:1782728034.935615:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 64 00000100:00100000:0.0:1782728034.935638:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+17:12640:x1869325552091904:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:0.0:1782728034.935723:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1782728034.935761:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f0600/0x22171c6c296152cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b78 expref: 17 pid: 7031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.935791:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56dd3ce600/0x22171c6c2961525b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b4e expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.935805:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8d56c9dbbc00) 00010000:00010000:0.0:1782728034.935823:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f94b1200/0x22171c6c296152af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b71 expref: 15 pid: 10280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.935855:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d03b0300) 00010000:00010000:0.0:1782728034.935863:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782728034.935895:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6000/0x22171c6c296152d2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.935909:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6000/0x22171c6c296152d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.935920:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6000/0x22171c6c296152d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.935933:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7c00/0x22171c6c296152d9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.935951:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7c00/0x22171c6c296152d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.935958:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7c00/0x22171c6c296152d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.936101:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6c00/0x22171c6c296152e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.936109:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6c00/0x22171c6c296152e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.936116:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6c00/0x22171c6c296152e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782728034.938307:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1782728034.938329:0:5806:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358891819572ns, next at 359891814788ns, rc = 0 00000040:00080000:0.0:1782728034.938429:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1782728034.938436:0:5806:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 358891926876ns, next at 359891925661ns, rc = 0 00010000:00010000:0.0:1782728034.938958:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6400/0x22171c6c296152e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.938979:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6400/0x22171c6c296152e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.938993:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6400/0x22171c6c296152e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.939003:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6400/0x22171c6c296152e7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.939010:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6400/0x22171c6c296152e7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.939017:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6400/0x22171c6c296152e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.939111:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782728034.939144:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6c00/0x22171c6c296152e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.939151:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6c00/0x22171c6c296152e0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.939157:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6c00/0x22171c6c296152e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.939164:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f9af6c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1782728034.939169:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6c00/0x22171c6c296152e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.939187:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6c00/0x22171c6c296152e0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.939203:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8d56d830b800) 00010000:00010000:0.0:1782728034.939206:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782728034.939213:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6c00/0x22171c6c296152e0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.939219:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6c00/0x22171c6c296152e0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.939255:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6000/0x22171c6c296152d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.939261:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6000/0x22171c6c296152d2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.939266:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6000/0x22171c6c296152d2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.939271:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f9af6000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1782728034.939274:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6000/0x22171c6c296152d2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.939280:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6000/0x22171c6c296152d2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.939287:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d830b900) 00010000:00010000:0.0:1782728034.939290:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782728034.939293:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6000/0x22171c6c296152d2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728034.939310:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6000/0x22171c6c296152d2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782728034.939327:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f0e15db2 reply state 00000000425bb90c transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7c00/0x22171c6c296152d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782728034.939338:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782728034.939466:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f55e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+16:12640:x1869325552091904:12345-192.168.202.31@tcp:36:rm.0 Request processed in 3834us (4306us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1782728034.939476:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 64 00010000:00010000:2.0:1782728034.940426:0:8303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782728034.940437:0:8303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6400/0x22171c6c296152e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728034.940446:0:8303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f9af6400 already unused, calling callback (ffffffffc152fcf0) 00010000:00010000:2.0:1782728034.940450:0:8303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6400/0x22171c6c296152e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728034.940458:0:8303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6400/0x22171c6c296152e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728034.940472:0:8303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x8:0x0].0x0 (ffff8d56d830b800) 00010000:00010000:2.0:1782728034.940475:0:8303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782728034.940479:0:8303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6400/0x22171c6c296152e7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728034.940485:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6400/0x22171c6c296152e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782728034.946771:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782728034.946791:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782728034.946794:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782728034.947646:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7c00/0x22171c6c296152d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.947674:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7c00/0x22171c6c296152d9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.947706:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7c00/0x22171c6c296152d9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.947713:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f9af7c00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1782728034.947718:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7c00/0x22171c6c296152d9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.947726:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7c00/0x22171c6c296152d9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.947747:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe701ffcf (ffff8d56d830be00) 00010000:00010000:3.0:1782728034.947751:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782728034.947757:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7c00/0x22171c6c296152d9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728034.947763:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7c00/0x22171c6c296152d9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xe701ffcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728035.317054:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782728036.101162:0:6630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1782728036.143849:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1782728036.143877:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:1.0:1782728036.334487:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782728036.349207:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782728036.349998:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552092032 00000100:00100000:0.0:1782728036.350014:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552092032 00000100:00100000:0.0:1782728036.350132:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 65 00000100:00100000:0.0:1782728036.350146:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+15:12682:x1869325552092032:12345-192.168.202.31@tcp:101:multiop.0 00010000:00010000:0.0:1782728036.350185:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1782728036.350297:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782728036.350575:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6e00/0x22171c6c296152ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20b7f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728036.350674:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7a00/0x22171c6c296152f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728036.351593:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7a00/0x22171c6c296152f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728036.351617:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7a00/0x22171c6c296152f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782728036.351840:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782728036.351845:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1782728036.351968:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7a00/0x22171c6c296152f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728036.352015:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6e00/0x22171c6c296152ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b7f expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728036.352040:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7a00/0x22171c6c296152f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b7f expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728036.352051:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d830bb00) 00010000:00010000:0.0:1782728036.352055:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782728036.352059:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f9af7a00, rc 0) 00000100:00100000:0.0:1782728036.355020:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+16:12682:x1869325552092032:12345-192.168.202.31@tcp:101:multiop.0 Request processed in 4856us (5806us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728036.355037:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 65 00000100:00100000:0.0:1782728036.389914:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728036.390540:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552092288 00000100:00100000:3.0:1782728036.390554:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552092288 00000100:00100000:3.0:1782728036.390625:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 66 00000100:00100000:3.0:1782728036.390637:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+16:12682:x1869325552092288:12345-192.168.202.31@tcp:101:multiop.0 00010000:00010000:3.0:1782728036.390664:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782728036.390669:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782728036.390833:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af7a00/0x22171c6c296152f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b7f expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728036.390936:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56d830bb00) 00010000:00010000:3.0:1782728036.390952:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782728036.390975:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1400/0x22171c6c296152fc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20b86 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728036.394644:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1e00/0x22171c6c29615303 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728036.394681:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1e00/0x22171c6c29615303 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728036.394711:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1e00/0x22171c6c29615303 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728036.394736:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1000/0x22171c6c2961530a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728036.394745:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1000/0x22171c6c2961530a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728036.394753:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1000/0x22171c6c2961530a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782728036.404164:0:5808:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1782728036.405912:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6e00/0x22171c6c29615311 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728036.405952:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6e00/0x22171c6c29615311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728036.405966:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6e00/0x22171c6c29615311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728036.406018:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1e00/0x22171c6c29615303 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728036.406045:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1e00/0x22171c6c29615303 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728036.406053:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1e00/0x22171c6c29615303 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728036.406060:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f44f1e00 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:0.0:1782728036.406067:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1e00/0x22171c6c29615303 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728036.406075:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1e00/0x22171c6c29615303 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728036.406091:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d56c4d03600) 00010000:00010000:0.0:1782728036.406094:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782728036.406099:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1e00/0x22171c6c29615303 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728036.406104:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1e00/0x22171c6c29615303 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782728036.406124:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000231880ca reply state 00000000b7156902 transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1000/0x22171c6c2961530a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782728036.406135:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782728036.406187:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1400/0x22171c6c296152fc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b86 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728036.406212:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f9af6e00/0x22171c6c29615311 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b86 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782728036.406230:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d56d830b900) 00010000:00010000:0.0:1782728036.406233:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782728036.406236:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f9af6e00, rc 0) 00000100:00100000:0.0:1782728036.406363:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+18:12682:x1869325552092288:12345-192.168.202.31@tcp:101:multiop.0 Request processed in 15725us (16461us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1782728036.406373:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 66 00010000:00010000:3.0:1782728036.421612:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1000/0x22171c6c2961530a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728036.421638:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1000/0x22171c6c2961530a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728036.421648:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1000/0x22171c6c2961530a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728036.421686:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f44f1000 already unused, calling callback (ffffffffc1f6a4f0) 00010000:00010000:3.0:1782728036.421700:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1000/0x22171c6c2961530a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728036.421710:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1000/0x22171c6c2961530a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728036.421733:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1e182d30 (ffff8d56c4d03100) 00010000:00010000:3.0:1782728036.421737:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782728036.421742:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1000/0x22171c6c2961530a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728036.421750:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d56f44f1000/0x22171c6c2961530a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x1e182d30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782728036.424411:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728036.424535:0:8323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552092416 00000100:00100000:1.0:1782728036.424550:0:8323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552092416 00000100:00100000:1.0:1782728036.424646:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 29 00000100:00100000:1.0:1782728036.424668:0:8323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f997ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+6:12682:x1869325552092416:12345-192.168.202.31@tcp:101:multiop.0 00010000:00010000:1.0:1782728036.424694:0:8323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782728036.424721:0:8323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a61da836/0x22171c6c2961531f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x44e8af495f20b8d expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782728036.424755:0:8323:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782728036.424783:0:8323:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=360s v=(0 0) 00010000:00010000:1.0:1782728036.424788:0:8323:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782728036.424800:0:8323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a61da836/0x22171c6c2961531f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b8d expref: 7 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728036.424820:0:8323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a61da836/0x22171c6c2961531f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b8d expref: 7 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728036.424859:0:8323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d56f94b1800, rc 0) 00000100:00100000:1.0:1782728036.424963:0:8323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f997ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:12682:x1869325552092416:12345-192.168.202.31@tcp:101:multiop.0 Request processed in 298us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728036.424970:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 29 00000100:00080000:3.0:1782728036.426107:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782728036.439144:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728036.439274:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552092544 00000100:00100000:1.0:1782728036.439288:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552092544 00002000:00100000:1.0:1782728036.439360:0:6611:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->4095) req@ffff8d56f55e2d80 x1869325552092544/t0(0) o4->f9926b93-a1e5-4dad-ade1-7cd7c966fac6@192.168.202.31@tcp:152/0 lens 4584/0 e 0 to 0 dl 1782728047 ref 1 fl New:/600/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782728036.439373:0:6611:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8d56f55e2d80 with x1869325552092544 ext(0->4095) 00002000:00010000:1.0:1782728036.439381:0:6611:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d56f55e2d80 00000100:00100000:1.0:1782728036.439424:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 11 00000100:00100000:1.0:1782728036.439436:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f55e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:2352:x1869325552092544:12345-192.168.202.31@tcp:4:multiop.0 00000001:00020000:1.0:1782728036.439455:0:6611:0:(tgt_handler.c:2784:tgt_brw_write()) cfs_fail_timeout id 214 sleeping for 5000ms 00000004:00080000:0.0:1782728036.973988:0:6700:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360927475461ns, next at 361927472088ns, rc = 0 00000100:00100000:1.0:1782728036.974358:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f9979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572043520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782728036.974473:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782728036.974595:0:8059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572043520 00000100:00100000:1.0:1782728036.974605:0:8059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572043520 00000100:00100000:1.0:1782728036.974678:0:8059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782728036.974689:0:8059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c9951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572043520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782728036.974736:0:8059:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782728036.974791:0:8059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c9951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869325572043520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728036.974799:0:8059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1782728036.974845:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782728036.974894:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f9979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1869325572043520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782728036.976577:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff79f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869325572043904:0@lo:400:kworker.0 00000100:00100000:3.0:1782728036.976668:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782728036.976726:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782728036.976733:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869325572044032:0@lo:400:kworker.0 00000100:00100000:3.0:1782728036.976759:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728036.976846:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56ff79ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869325572043776:0@lo:400:kworker.0 00000100:00100000:0.0:1782728036.976880:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728036.976910:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782728036.976917:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3317:1869325572043648:0@lo:400:kworker.0 00000100:00100000:0.0:1782728036.976961:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728036.977001:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f5cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572044160:0@lo:400:kworker.0 00000100:00100000:0.0:1782728036.977031:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782728036.977063:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572043904 00000100:00100000:0.0:1782728036.977071:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572043904 00000100:00100000:0.0:1782728036.977140:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572044032 00000100:00100000:0.0:1782728036.977143:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572044032 00000100:00100000:0.0:1782728036.977165:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572043776 00000100:00100000:0.0:1782728036.977167:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572043776 00000100:00100000:0.0:1782728036.977182:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1782728036.977190:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f996b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869325572043904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782728036.977267:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f996b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869325572043904:12345-0@lo:400:kworker.0 Request processed in 65us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728036.977298:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1782728036.977320:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1782728036.977326:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869325572044032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782728036.977356:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869325572044032:12345-0@lo:400:kworker.0 Request processed in 30us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728036.977361:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1782728036.977371:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1782728036.977377:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869325572043776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782728036.977573:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869325572043776:12345-0@lo:400:kworker.0 Request processed in 195us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728036.977579:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1782728036.977600:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572043648 00000100:00100000:0.0:1782728036.977604:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572043648 00000100:00100000:0.0:1782728036.977630:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1782728036.977637:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3317:x1869325572043648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782728036.977668:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0853c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365+19:3317:x1869325572043648:12345-0@lo:400:kworker.0 Request processed in 32us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728036.977675:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1782728036.977706:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572044160 00000100:00100000:0.0:1782728036.977709:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572044160 00000100:00100000:0.0:1782728036.977739:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782728036.977745:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f997b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572044160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782728036.977775:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f997b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869325572044160:12345-0@lo:400:kworker.0 Request processed in 31us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1782728036.977782:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782728036.977835:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f55e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:be2b8b9a-65d9-4ad9-ab60-33b0c7c11365:3317:1869325572043648:0@lo:400:kworker.0 00000100:00100000:0.0:1782728036.977851:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f5cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1869325572044160:0@lo:400:kworker.0 00000100:00100000:0.0:1782728036.977860:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff79ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869325572043776:0@lo:400:kworker.0 00000100:00100000:0.0:1782728036.977901:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff79f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1869325572044032:0@lo:400:kworker.0 00000100:00100000:0.0:1782728036.977914:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56ff79f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1869325572043904:0@lo:400:kworker.0 00000100:00080000:1.0:1782728036.978239:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782728036.978246:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782728037.359551:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782728037.485880:0:7865:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361439367000ns, next at 362439363395ns, rc = 0 00000100:00100000:1.0:1782728037.485958:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782728037.485988:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f996a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572044288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782728037.486087:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782728037.486283:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572044288 00000100:00100000:3.0:1782728037.486294:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572044288 00000100:00100000:3.0:1782728037.486366:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782728037.486378:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c9952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572044288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782728037.486431:0:6608:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782728037.486499:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c9952a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869325572044288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728037.486556:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782728037.486672:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f996a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1869325572044288:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782728038.381691:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782728038.621976:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728038.622025:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728038.622055:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782728038.622087:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552092800 00000100:00100000:3.0:1782728038.622096:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552092800 00000100:00100000:3.0:1782728038.622151:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 131 00000100:00100000:3.0:1782728038.622161:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f996aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+17:2352:x1869325552092800:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782728038.622243:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f996aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+17:2352:x1869325552092800:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 84us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1782728038.622251:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 131 00000100:00100000:1.0:1782728038.622610:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552092672 00000100:00100000:1.0:1782728038.622615:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552092672 00000100:00100000:1.0:1782728038.622648:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 254 00000100:00100000:1.0:1782728038.622655:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56d0850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2352:x1869325552092672:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782728038.622683:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56d0850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b661aafc-708f-4f38-b71b-eec242d406b4+10:2352:x1869325552092672:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 29us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728038.622690:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 254 00000100:00080000:1.0:1782728038.622717:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782728038.623718:0:8323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552092928 00000100:00100000:2.0:1782728038.623726:0:8323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552092928 00000100:00100000:2.0:1782728038.623785:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 66 00000100:00100000:2.0:1782728038.623806:0:8323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:2352:x1869325552092928:12345-192.168.202.31@tcp:400:kworker.0 00000100:00080000:3.0:1782728038.624369:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782728038.625368:0:8323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:2352:x1869325552092928:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 1568us (3335us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728038.625380:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 66 00000100:00100000:3.0:1782728038.626017:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782728038.626280:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552093056 00000100:00100000:2.0:1782728038.626287:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552093056 00000100:00100000:2.0:1782728038.626342:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 67 00000100:00100000:2.0:1782728038.626351:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f9968e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:2352:x1869325552093056:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782728038.626401:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f9968e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:2352:x1869325552093056:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 51us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1782728038.626407:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 67 00000100:00080000:3.0:1782728038.628964:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782728039.410044:0:8304:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782728039.422033:0:12448:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity test_118d: @@@@@@ FAIL: No page in writeback, writeback=0 00000004:00080000:1.0:1782728039.650092:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000001:00080000:1.0:1782728039.650150:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967335 is committed 00000004:00080000:1.0:1782728039.650159:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:1.0:1782728039.650162:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:1.0:1782728039.650218:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:1.0:1782728039.650227:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967336 is committed 00000100:00100000:1.0:1782728039.650417:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c9950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572044416:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782728039.650542:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782728039.650631:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572044416 00000100:00100000:1.0:1782728039.650641:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572044416 00000100:00100000:1.0:1782728039.650708:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782728039.650719:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56c9950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572044416:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782728039.650765:0:6604:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00010000:00010000:1.0:1782728039.650799:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d551e1b9/0x22171c6c29615326 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.650827:0:6604:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091f3bc2d/0x22171c6c2961529a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b63 expref: 7 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.650837:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782728039.650841:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782728039.650846:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d551e1b9/0x22171c6c29615326 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.650877:0:6604:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091f3bc2d/0x22171c6c2961529a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b63 expref: 7 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.650893:0:6604:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091f3bc2d/0x22171c6c2961529a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b63 expref: 7 pid: 8323 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782728039.650917:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56c9953b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6604:1869325572044544:192.168.202.31@tcp:104: 00000100:00100000:1.0:1782728039.650982:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d570133e600 going to sleep for 11 seconds 00000100:00080000:1.0:1782728039.650994:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782728039.652107:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782728039.652138:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f996bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572044672:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1782728039.652218:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782728039.657967:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325572044672 00000100:00100000:3.0:1782728039.657988:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325572044672 00000100:00100000:3.0:1782728039.658177:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782728039.658191:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869325572044672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1782728039.658240:0:6606:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:6 count 1 00010000:00010000:3.0:1782728039.658275:0:6606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f08ebbf/0x22171c6c2961532d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728039.658303:0:6606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000353d0a84/0x22171c6c296152a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b6a expref: 6 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728039.658314:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=5s v=(0 0) 00010000:00010000:3.0:1782728039.658331:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782728039.658336:0:6606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f08ebbf/0x22171c6c2961532d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728039.658383:0:6606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000353d0a84/0x22171c6c296152a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b6a expref: 6 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728039.658399:0:6606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000353d0a84/0x22171c6c296152a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b6a expref: 6 pid: 6607 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782728039.658417:0:6606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8d56f9969180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6606:1869325572044800:192.168.202.31@tcp:104: 00000100:00100000:3.0:1782728039.658556:0:6606:0:(client.c:2701:ptlrpc_set_wait()) set ffff8d56d826eb40 going to sleep for 11 seconds 00000100:00080000:0.0:1782728039.658576:0:5802:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782728039.669671:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728039.669716:0:6620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552093184 00000100:00100000:1.0:1782728039.669727:0:6620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552093184 00010000:00010000:1.0:1782728039.669784:0:6620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091f3bc2d/0x22171c6c2961529a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b63 expref: 8 pid: 8323 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782728039.669849:0:6620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 35 00000100:00100000:1.0:1782728039.669862:0:6620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f5c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:2354:x1869325552093184:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782728039.669882:0:6620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782728039.669888:0:6620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091f3bc2d/0x22171c6c2961529a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b63 expref: 8 pid: 8323 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.669913:0:6620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091f3bc2d/0x22171c6c2961529a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b63 expref: 8 pid: 8323 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.669946:0:6620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782728039.669950:0:6620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782728039.669957:0:6620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d551e1b9/0x22171c6c29615326 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.669967:0:6620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d551e1b9/0x22171c6c29615326 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.669993:0:6620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782728039.670056:0:6620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5c38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+8:2354:x1869325552093184:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 196us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728039.670065:0:6620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 35 00010000:00010000:3.0:1782728039.672663:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091f3bc2d/0x22171c6c2961529a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b63 expref: 7 pid: 8323 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782728039.672687:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c9953b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6604:1869325572044544:192.168.202.31@tcp:104: 00010000:00010000:3.0:1782728039.672717:0:6604:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d551e1b9/0x22171c6c29615326 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728039.672731:0:6604:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d551e1b9/0x22171c6c29615326 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728039.672740:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d551e1b9/0x22171c6c29615326 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728039.672754:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d551e1b9/0x22171c6c29615326 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728039.672771:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d551e1b9/0x22171c6c29615326 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782728039.672789:0:6604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782728039.673281:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782728039.673291:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d551e1b9/0x22171c6c29615326 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.673313:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f94b0a00 already unused, calling callback (ffffffffc152fcf0) 00010000:00010000:1.0:1782728039.673317:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d551e1b9/0x22171c6c29615326 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.673328:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d551e1b9/0x22171c6c29615326 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.673352:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d551e1b9/0x22171c6c29615326 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.673360:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d551e1b9/0x22171c6c29615326 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.673382:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782728039.673384:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782728039.673386:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782728039.677338:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56c9950000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1869325572044416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 26603us (26779us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1782728039.677358:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782728039.681554:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782728039.681699:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869325552093312 00000100:00100000:1.0:1782728039.681711:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869325552093312 00010000:00010000:1.0:1782728039.681766:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000353d0a84/0x22171c6c296152a1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b6a expref: 7 pid: 6607 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782728039.681814:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 36 00000100:00100000:1.0:1782728039.681825:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d56f996a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:2355:x1869325552093312:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782728039.681848:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782728039.681854:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000353d0a84/0x22171c6c296152a1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b6a expref: 7 pid: 6607 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.681889:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000353d0a84/0x22171c6c296152a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b6a expref: 7 pid: 6607 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.681940:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782728039.681946:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782728039.681953:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f08ebbf/0x22171c6c2961532d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.681965:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f08ebbf/0x22171c6c2961532d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.681992:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782728039.682060:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f996a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9926b93-a1e5-4dad-ade1-7cd7c966fac6+7:2355:x1869325552093312:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 236us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1782728039.682069:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 36 00010000:00010000:1.0:1782728039.682261:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000353d0a84/0x22171c6c296152a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.31@tcp remote: 0x44e8af495f20b6a expref: 6 pid: 6607 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782728039.682281:0:6606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f9969180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6606:1869325572044800:192.168.202.31@tcp:104: 00010000:00010000:1.0:1782728039.682308:0:6606:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003f08ebbf/0x22171c6c2961532d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.682321:0:6606:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003f08ebbf/0x22171c6c2961532d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.682340:0:6606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f08ebbf/0x22171c6c2961532d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.682352:0:6606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f08ebbf/0x22171c6c2961532d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.682361:0:6606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f08ebbf/0x22171c6c2961532d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.682385:0:6606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782728039.683108:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d56f5ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1869325572044672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24918us (30886us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1782728039.683119:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1782728039.683151:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782728039.683159:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f08ebbf/0x22171c6c2961532d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.683170:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d56f44f1000 already unused, calling callback (ffffffffc152fcf0) 00010000:00010000:1.0:1782728039.683175:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f08ebbf/0x22171c6c2961532d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.683185:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f08ebbf/0x22171c6c2961532d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.683203:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f08ebbf/0x22171c6c2961532d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.683217:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f08ebbf/0x22171c6c2961532d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782728039.683241:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782728039.683243:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782728039.683245:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782728039.686422:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d56c9950e00/2, rc 0, transno 4294967305 00000100:00100000:2.0:1782728039.686444:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56c9950e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572044416:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1782728039.688442:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d56f996bb80/2, rc 0, transno 4294967308 00000100:00100000:1.0:1782728039.688461:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8d56f996bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1869325572044672:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782728040.429813:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782728041.189696:0:6630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:3.0:1782728041.230982:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed Debug log: 12002 lines, 12002 kept, 0 dropped, 0 bad.